Nov 16 19:17:31 user nova-compute[86931]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=86931) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=86931) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=86931) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 19:17:31 user nova-compute[86931]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:17:31 user nova-compute[86931]: INFO nova.virt.driver [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 19:17:31 user nova-compute[86931]: INFO nova.compute.provider_config [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Acquiring lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Acquired lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Releasing lock "singleton_lock" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Full set of CONF: {{(pid=86931) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Configuration options gathered from: {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ================================================================================ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] allow_resize_to_same_host      = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] arq_binding_timeout            = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] backdoor_port                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] backdoor_socket                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] block_device_allocate_retries  = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] block_device_allocate_retries_interval = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cert                           = self.pem {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute_monitors               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] config_dir                     = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] config_drive_format            = iso9660 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] config_source                  = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] console_host                   = user {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] control_exchange               = nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cpu_allocation_ratio           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] daemon                         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] debug                          = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_access_ip_network_name = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_availability_zone      = nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_ephemeral_format       = ext4 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_green_pool_size        = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] default_schedule_zone          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] disk_allocation_ratio          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] enable_new_services            = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] enabled_ssl_apis               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] flat_injected                  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] force_config_drive             = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] force_raw_images               = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] graceful_shutdown_timeout      = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] heal_instance_info_cache_interval = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] host                           = user {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_build_timeout         = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_delete_interval       = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_name_template         = instance-%08x {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_usage_audit           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_usage_audit_period    = month {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] internal_service_availability_zone = internal {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] key                            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] live_migration_retry_count     = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_config_append              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_dir                        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_file                       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_options                    = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_rotate_interval            = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_rotate_interval_type       = days {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] log_rotation_type              = none {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] long_rpc_timeout               = 1800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_concurrent_builds          = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_concurrent_live_migrations = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_concurrent_snapshots       = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_local_block_devices        = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_logfile_count              = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] max_logfile_size_mb            = 200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] maximum_instance_delete_attempts = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metadata_listen                = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metadata_listen_port           = 8775 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metadata_workers               = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] migrate_max_retries            = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] mkisofs_cmd                    = genisoimage {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] my_ip                          = 10.0.0.210 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] network_allocate_retries       = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] osapi_compute_listen_port      = 8774 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] osapi_compute_unique_server_name_scope =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] osapi_compute_workers          = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] password_length                = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] periodic_enable                = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] periodic_fuzzy_delay           = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] pointer_model                  = ps2mouse {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] preallocate_images             = none {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] publish_errors                 = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] pybasedir                      = /opt/stack/nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ram_allocation_ratio           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rate_limit_burst               = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rate_limit_except_level        = CRITICAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rate_limit_interval            = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reboot_timeout                 = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reclaim_instance_interval      = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] record                         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reimage_timeout_per_gb         = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] report_interval                = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rescue_timeout                 = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reserved_host_cpus             = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reserved_host_disk_mb          = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reserved_host_memory_mb        = 512 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] reserved_huge_pages            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] resize_confirm_window          = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] resize_fs_using_block_device   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] resume_guests_state_on_host_boot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rpc_response_timeout           = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] run_external_periodic_tasks    = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] running_deleted_instance_action = reap {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] running_deleted_instance_timeout = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler_instance_sync_interval = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_down_time              = 720 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] servicegroup_driver            = db {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] shelved_offload_time           = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] shelved_poll_interval          = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] shutdown_timeout               = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] source_is_ipv6                 = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ssl_only                       = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] state_path                     = /opt/stack/data/nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] sync_power_state_interval      = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] sync_power_state_pool_size     = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] syslog_log_facility            = LOG_USER {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] tempdir                        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] timeout_nbd                    = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] transport_url                  = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] update_resources_interval      = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_cow_images                 = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_eventlog                   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_journal                    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_json                       = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_rootwrap_daemon            = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_stderr                     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] use_syslog                     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vcpu_pin_set                   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plugging_is_fatal          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plugging_timeout           = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] virt_mkfs                      = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] volume_usage_poll_interval     = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] watch_log_file                 = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] web                            = /usr/share/spice-html5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.auth_strategy              = keystone {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.compute_link_prefix        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.dhcp_domain                = novalocal {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.enable_instance_password   = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.glance_link_prefix         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.instance_list_per_project_cells = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.list_records_by_skipping_down_cells = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.local_metadata_per_cell    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.max_limit                  = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.metadata_cache_expiration  = 15 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.neutron_default_tenant_id  = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.use_forwarded_for          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.use_neutron_default_nets   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_dynamic_targets = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_jsonfile_path   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.backend_argument         = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.config_prefix            = cache.oslo {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.dead_timeout             = 60.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.debug_cache_backend      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.enable_retry_client      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.enable_socket_keepalive  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.enabled                  = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.expiration_time          = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_dead_retry      = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_password        =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_sasl_enabled    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.memcache_username        =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.proxies                  = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.retry_attempts           = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.retry_delay              = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.socket_keepalive_count   = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.socket_keepalive_idle    = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.socket_keepalive_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.tls_allowed_ciphers      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.tls_cafile               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.tls_certfile             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.tls_enabled              = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cache.tls_keyfile              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.auth_section            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.auth_type               = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.cafile                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.certfile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.collect_timing          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.cross_az_attach         = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.debug                   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.endpoint_template       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.http_retries            = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.insecure                = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.keyfile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.os_region_name          = RegionOne {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.split_loggers           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cinder.timeout                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.cpu_dedicated_set      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.cpu_shared_set         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.image_type_exclude_list = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.resource_provider_association_refresh = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.shutdown_retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] conductor.workers              = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] console.allowed_origins        = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] console.ssl_ciphers            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] console.ssl_minimum_version    = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] consoleauth.token_ttl          = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.cafile                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.certfile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.collect_timing          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.connect_retries         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.connect_retry_delay     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.endpoint_override       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.insecure                = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.keyfile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.max_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.min_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.region_name             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.service_name            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.service_type            = accelerator {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.split_loggers           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.status_code_retries     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.timeout                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] cyborg.version                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.backend               = sqlalchemy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.connection            = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.connection_debug      = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.connection_parameters =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.connection_recycle_time = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.connection_trace      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.db_inc_retry_interval = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.db_max_retries        = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.db_max_retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.db_retry_interval     = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.max_overflow          = 50 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.max_pool_size         = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.max_retries           = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.pool_timeout          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.retry_interval        = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.slave_connection      = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] database.sqlite_synchronous    = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.backend           = sqlalchemy {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.connection        = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.connection_debug  = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.connection_parameters =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.connection_recycle_time = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.connection_trace  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.db_inc_retry_interval = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.db_max_retries    = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.db_max_retry_interval = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.db_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.max_overflow      = 50 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.max_pool_size     = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.max_retries       = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.pool_timeout      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.retry_interval    = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.slave_connection  = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] api_database.sqlite_synchronous = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] devices.enabled_mdev_types     = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:31 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ephemeral_storage_encryption.enabled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.api_servers             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.cafile                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.certfile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.collect_timing          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.connect_retries         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.connect_retry_delay     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.debug                   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.default_trusted_certificate_ids = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.enable_certificate_validation = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.enable_rbd_download     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.endpoint_override       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.insecure                = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.keyfile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.max_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.min_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.num_retries             = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.rbd_ceph_conf           =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.rbd_connect_timeout     = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.rbd_pool                =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.rbd_user                =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.region_name             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.service_name            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.service_type            = image {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.split_loggers           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.status_code_retries     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.timeout                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.verify_glance_signatures = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] glance.version                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] guestfs.debug                  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.config_drive_cdrom      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.config_drive_inject_password = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.enable_remotefx         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.instances_path_share    =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.limit_cpu_features      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.use_multipath_io        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.vswitch_name            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] mks.enabled                    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.manager_interval   = 2400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.precache_concurrency = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.remove_unused_base_images = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] image_cache.subdirectory_name  = _base {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.api_max_retries         = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.api_retry_interval      = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.auth_section            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.auth_type               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.cafile                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.certfile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.collect_timing          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.conductor_group         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.connect_retries         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.connect_retry_delay     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.endpoint_override       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.insecure                = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.keyfile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.max_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.min_version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.peer_list               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.region_name             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.serial_console_state_timeout = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.service_name            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.service_type            = baremetal {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.split_loggers           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.status_code_retries     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.timeout                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ironic.version                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] key_manager.fixed_key          = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.barbican_api_version  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.barbican_endpoint     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.barbican_endpoint_type = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.barbican_region_name  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.cafile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.certfile              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.collect_timing        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.insecure              = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.keyfile               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.number_of_retries     = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.retry_delay           = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.send_service_user_token = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.split_loggers         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.timeout               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.verify_ssl            = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican.verify_ssl_path       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.auth_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.cafile   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.keyfile  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] barbican_service_user.timeout  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.approle_role_id          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.approle_secret_id        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.cafile                   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.certfile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.collect_timing           = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.insecure                 = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.keyfile                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.kv_mountpoint            = secret {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.kv_path                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.kv_version               = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.namespace                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.root_token_id            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.split_loggers            = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.ssl_ca_crt_file          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.timeout                  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.use_ssl                  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.auth_section          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.auth_type             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.cafile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.certfile              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.collect_timing        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.connect_retries       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.connect_retry_delay   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.endpoint_override     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.insecure              = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.keyfile               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.max_version           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.min_version           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.region_name           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.service_name          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.service_type          = identity {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.split_loggers         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.status_code_retries   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.timeout               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] keystone.version               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.connection_uri         =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_mode               = custom {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: WARNING oslo_config.cfg [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_power_governor_high = performance {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_power_management   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.device_detach_attempts = 8 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.device_detach_timeout  = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.disk_cachemodes        = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.disk_prefix            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.enabled_perf_events    = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.file_backed_memory     = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.gid_maps               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.hw_disk_discard        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.hw_machine_type        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_rbd_pool        = rbd {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_type            = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.images_volume_group    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.inject_key             = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.inject_partition       = -2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.inject_password        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.iscsi_iface            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.iser_use_multipath     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_downtime = 500 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_inbound_addr = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_scheme  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_timeout_action = abort {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_tunnelled = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: WARNING oslo_config.cfg [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 19:17:32 user nova-compute[86931]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 19:17:32 user nova-compute[86931]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 19:17:32 user nova-compute[86931]: and ``live_migration_inbound_addr`` respectively.
Nov 16 19:17:32 user nova-compute[86931]: ).  Its value may be silently ignored in the future.
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.live_migration_with_native_tls = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.max_queues             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.nfs_mount_options      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_pcie_ports         = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.pmem_namespaces        = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.quobyte_client_cfg     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rbd_secret_uuid        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rbd_user               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rescue_image_id        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rescue_kernel_id       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.rx_queue_size          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.smbfs_mount_options    =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.snapshot_compression   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.snapshot_image_format  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.sparse_logical_volumes = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.swtpm_enabled          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.swtpm_group            = tss {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.swtpm_user             = tss {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.sysinfo_serial         = unique {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.tb_cache_size          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.tx_queue_size          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.uid_maps               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.use_virtio_for_bridges = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.virt_type              = kvm {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.volume_clear           = zero {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.volume_clear_size      = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.volume_use_multipath   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_cache_path   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.auth_section           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.auth_type              = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.cafile                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.certfile               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.collect_timing         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.connect_retries        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.connect_retry_delay    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.default_floating_pool  = public {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.endpoint_override      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.extension_sync_interval = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.http_retries           = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.insecure               = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.keyfile                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.max_version            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.min_version            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.ovs_bridge             = br-int {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.physnets               = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.region_name            = RegionOne {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.service_metadata_proxy = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.service_name           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.service_type           = network {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.split_loggers          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.status_code_retries    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.timeout                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] neutron.version                = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] notifications.bdms_in_notifications = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] notifications.default_level    = INFO {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] notifications.notification_format = unversioned {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] notifications.notify_on_state_change = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] pci.alias                      = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] pci.device_spec                = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] pci.report_in_placement        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.auth_section         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.auth_type            = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.cafile               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.certfile             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.collect_timing       = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.connect_retries      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.connect_retry_delay  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.default_domain_id    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.default_domain_name  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.domain_id            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.domain_name          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.endpoint_override    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.insecure             = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.keyfile              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.max_version          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.min_version          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.password             = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.project_domain_id    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.project_domain_name  = Default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.project_id           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.project_name         = service {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.region_name          = RegionOne {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.service_name         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.service_type         = placement {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.split_loggers        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.status_code_retries  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.system_scope         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.timeout              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.trust_id             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.user_domain_id       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.user_domain_name     = Default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.user_id              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.username             = placement {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] placement.version              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.cores                    = 20 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.count_usage_from_placement = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.injected_file_content_bytes = 10240 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.injected_file_path_length = 255 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.injected_files           = 5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.instances                = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.key_pairs                = 100 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.metadata_items           = 128 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.ram                      = 51200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.recheck_quota            = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.server_group_members     = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] quota.server_groups            = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rdp.enabled                    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.image_metadata_prefilter = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.max_attempts         = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.max_placement_results = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] scheduler.workers              = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.host_subset_size = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.isolated_hosts = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.isolated_images = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.pci_in_placement = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.track_instance_changes = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metrics.required               = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metrics.weight_multiplier      = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] metrics.weight_setting         = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.enabled         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.port_range      = 10000:20000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] serial_console.serialproxy_port = 6083 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.auth_section      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.auth_type         = password {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.cafile            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.certfile          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.collect_timing    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.insecure          = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.keyfile           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.send_service_user_token = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.split_loggers     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] service_user.timeout           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.agent_enabled            = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.enabled                  = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.html5proxy_port          = 6082 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.image_compression        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.jpeg_compression         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.playback_compression     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.server_listen            = 127.0.0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.streaming_mode           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] spice.zlib_compression         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] upgrade_levels.baseapi         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] upgrade_levels.cert            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] upgrade_levels.compute         = auto {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] upgrade_levels.conductor       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] upgrade_levels.scheduler       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.cafile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.certfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.insecure = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vendordata_dynamic_auth.timeout = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.api_retry_count         = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.ca_file                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.cache_prefix            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.cluster_name            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.connection_pool_size    = 10 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.console_delay_seconds   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.datastore_regex         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.host_ip                 = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.host_password           = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.host_port               = 443 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.host_username           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.insecure                = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.integration_bridge      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.maximum_objects         = 100 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.pbm_default_policy      = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.pbm_enabled             = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.pbm_wsdl_location       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.serial_port_proxy_uri   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.serial_port_service_uri = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.task_poll_interval      = 0.5 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.use_linked_clone        = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.vnc_keymap              = en-us {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.vnc_port                = 5900 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vmware.vnc_port_total          = 10000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.auth_schemes               = ['none'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.enabled                    = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.novncproxy_port            = 6080 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.vencrypt_ca_certs          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.vencrypt_client_cert       = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vnc.vencrypt_client_key        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.disable_rootwrap   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.enable_numa_live_migration = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.libvirt_disable_apic = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.client_socket_timeout     = 900 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.default_pool_size         = 1000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.keep_alive                = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.max_header_line           = 16384 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.ssl_ca_file               = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.ssl_cert_file             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.ssl_key_file              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.tcp_keepidle              = 600 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] zvm.ca_file                    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] zvm.cloud_connector_url        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] zvm.reachable_timeout          = 300 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.enforce_scope      = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.policy_default_rule = default {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.connection_string     = messaging:// {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.enabled               = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.es_doc_type           = notification {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.es_scroll_size        = 10000 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.es_scroll_time        = 2m {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.filter_error_trace    = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.hmac_keys             = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.sentinel_service_name = mymaster {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.socket_timeout        = 0.1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.trace_requests        = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler.trace_sqlalchemy      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler_jaeger.process_tags   = {} {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] profiler_otlp.service_name_prefix = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] remote_debug.host              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] remote_debug.port              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.auth_section        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.auth_type           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.cafile              = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.certfile            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.collect_timing      = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.connect_retries     = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.connect_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.endpoint_id         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.endpoint_override   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.insecure            = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.keyfile             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.max_version         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.min_version         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.region_name         = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.service_name        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.service_type        = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.split_loggers       = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.status_code_retries = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.status_code_retry_delay = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.timeout             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.valid_interfaces    = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_limit.version             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_reports.file_event_handler = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] oslo_reports.log_dir           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.group  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] vif_plug_ovs_privileged.user   = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.isolate_vif         = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] os_brick.lock_path             = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.capabilities   = [21] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.group          = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.helper_command = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] privsep_osbrick.user           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.group           = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.helper_command  = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] nova_sys_admin.user            = None {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG oslo_service.service [None req-6b566d64-900b-4203-a501-7db1140612d4 None None] ******************************************************************************** {{(pid=86931) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 19:17:32 user nova-compute[86931]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Connecting to libvirt: qemu:///system {{(pid=86931) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7faa5dc9a440> {{(pid=86931) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 19:17:32 user nova-compute[86931]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 19:17:32 user nova-compute[86931]: WARNING nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7faa5dc9a440> {{(pid=86931) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Starting native event thread {{(pid=86931) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Starting green dispatch thread {{(pid=86931) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Starting connection event dispatch thread {{(pid=86931) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 19:17:32 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Connection event '1' reason 'None'
Nov 16 19:17:32 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 19:17:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.mount [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Initialising _HostMountState generation 0 {{(pid=86931) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 19:17:39 user nova-compute[86931]: INFO nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host capabilities <capabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <host>
Nov 16 19:17:39 user nova-compute[86931]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 19:17:39 user nova-compute[86931]:     <cpu>
Nov 16 19:17:39 user nova-compute[86931]:       <arch>x86_64</arch>
Nov 16 19:17:39 user nova-compute[86931]:       <model>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <microcode version='1070'/>
Nov 16 19:17:39 user nova-compute[86931]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='osxsave'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='invtsc'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='rsba'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 19:17:39 user nova-compute[86931]:       <pages unit='KiB' size='4'/>
Nov 16 19:17:39 user nova-compute[86931]:       <pages unit='KiB' size='2048'/>
Nov 16 19:17:39 user nova-compute[86931]:     </cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <power_management>
Nov 16 19:17:39 user nova-compute[86931]:       <suspend_mem/>
Nov 16 19:17:39 user nova-compute[86931]:       <suspend_disk/>
Nov 16 19:17:39 user nova-compute[86931]:       <suspend_hybrid/>
Nov 16 19:17:39 user nova-compute[86931]:     </power_management>
Nov 16 19:17:39 user nova-compute[86931]:     <iommu support='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <migration_features>
Nov 16 19:17:39 user nova-compute[86931]:       <live/>
Nov 16 19:17:39 user nova-compute[86931]:       <uri_transports>
Nov 16 19:17:39 user nova-compute[86931]:         <uri_transport>tcp</uri_transport>
Nov 16 19:17:39 user nova-compute[86931]:         <uri_transport>rdma</uri_transport>
Nov 16 19:17:39 user nova-compute[86931]:       </uri_transports>
Nov 16 19:17:39 user nova-compute[86931]:     </migration_features>
Nov 16 19:17:39 user nova-compute[86931]:     <topology>
Nov 16 19:17:39 user nova-compute[86931]:       <cells num='2'>
Nov 16 19:17:39 user nova-compute[86931]:         <cell id='0'>
Nov 16 19:17:39 user nova-compute[86931]:           <memory unit='KiB'>8189224</memory>
Nov 16 19:17:39 user nova-compute[86931]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 16 19:17:39 user nova-compute[86931]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 19:17:39 user nova-compute[86931]:           <distances>
Nov 16 19:17:39 user nova-compute[86931]:             <sibling id='0' value='10'/>
Nov 16 19:17:39 user nova-compute[86931]:             <sibling id='1' value='20'/>
Nov 16 19:17:39 user nova-compute[86931]:           </distances>
Nov 16 19:17:39 user nova-compute[86931]:           <cpus num='6'>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 19:17:39 user nova-compute[86931]:           </cpus>
Nov 16 19:17:39 user nova-compute[86931]:         </cell>
Nov 16 19:17:39 user nova-compute[86931]:         <cell id='1'>
Nov 16 19:17:39 user nova-compute[86931]:           <memory unit='KiB'>8206460</memory>
Nov 16 19:17:39 user nova-compute[86931]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 16 19:17:39 user nova-compute[86931]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 19:17:39 user nova-compute[86931]:           <distances>
Nov 16 19:17:39 user nova-compute[86931]:             <sibling id='0' value='20'/>
Nov 16 19:17:39 user nova-compute[86931]:             <sibling id='1' value='10'/>
Nov 16 19:17:39 user nova-compute[86931]:           </distances>
Nov 16 19:17:39 user nova-compute[86931]:           <cpus num='6'>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 19:17:39 user nova-compute[86931]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 19:17:39 user nova-compute[86931]:           </cpus>
Nov 16 19:17:39 user nova-compute[86931]:         </cell>
Nov 16 19:17:39 user nova-compute[86931]:       </cells>
Nov 16 19:17:39 user nova-compute[86931]:     </topology>
Nov 16 19:17:39 user nova-compute[86931]:     <cache>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 19:17:39 user nova-compute[86931]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 19:17:39 user nova-compute[86931]:     </cache>
Nov 16 19:17:39 user nova-compute[86931]:     <secmodel>
Nov 16 19:17:39 user nova-compute[86931]:       <model>apparmor</model>
Nov 16 19:17:39 user nova-compute[86931]:       <doi>0</doi>
Nov 16 19:17:39 user nova-compute[86931]:     </secmodel>
Nov 16 19:17:39 user nova-compute[86931]:     <secmodel>
Nov 16 19:17:39 user nova-compute[86931]:       <model>dac</model>
Nov 16 19:17:39 user nova-compute[86931]:       <doi>0</doi>
Nov 16 19:17:39 user nova-compute[86931]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 19:17:39 user nova-compute[86931]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 19:17:39 user nova-compute[86931]:     </secmodel>
Nov 16 19:17:39 user nova-compute[86931]:   </host>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='alpha'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>clipper</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='armv6l'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>spitz</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>nuri</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>kzm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>z2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>tosa</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n810</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>terrier</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>midway</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>microbit</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>verdex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>highbank</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>akita</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>connex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>collie</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='armv7l'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>spitz</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>nuri</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>kzm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>z2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>tosa</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n810</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>terrier</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>midway</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>microbit</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>verdex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>highbank</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>akita</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>connex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>collie</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='aarch64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>spitz</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>nuri</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>kzm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>z2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>tosa</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n810</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>n800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>terrier</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>midway</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>microbit</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>verdex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>highbank</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>akita</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>connex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>collie</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <acpi default='on' toggle='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='cris'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='i686'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>isapc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>microvm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='kvm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <pae/>
Nov 16 19:17:39 user nova-compute[86931]:       <nonpae/>
Nov 16 19:17:39 user nova-compute[86931]:       <acpi default='on' toggle='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:       <apic default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='m68k'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>an5206</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>q800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='microblaze'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='microblazeel'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='mips'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>malta</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='mipsel'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>malta</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='mips64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>malta</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>pica61</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>magnum</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='mips64el'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>malta</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>pica61</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>magnum</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='16'>boston</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='ppc'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mac99</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>40p</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>taihu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='ppc64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>taihu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>40p</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mac99</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='ppc64le'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>taihu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>40p</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>mac99</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='riscv32'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='8'>spike</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='8'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='riscv64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='8'>spike</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='8'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='s390x'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='sh4'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>shix</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>r2d</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='sh4eb'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>shix</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>r2d</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='sparc'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>LX</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='sparc64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>niagara</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='x86_64'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>64</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='1'>isapc</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>microvm</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='kvm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <acpi default='on' toggle='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:       <apic default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='xtensa'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>sim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>kc705</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ml605</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx200</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx60</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]:   <guest>
Nov 16 19:17:39 user nova-compute[86931]:     <os_type>hvm</os_type>
Nov 16 19:17:39 user nova-compute[86931]:     <arch name='xtensaeb'>
Nov 16 19:17:39 user nova-compute[86931]:       <wordsize>32</wordsize>
Nov 16 19:17:39 user nova-compute[86931]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='4'>sim</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>kc705</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ml605</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>virt</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx200</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>lx60</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 19:17:39 user nova-compute[86931]:       <domain type='qemu'/>
Nov 16 19:17:39 user nova-compute[86931]:     </arch>
Nov 16 19:17:39 user nova-compute[86931]:     <features>
Nov 16 19:17:39 user nova-compute[86931]:       <cpuselection/>
Nov 16 19:17:39 user nova-compute[86931]:       <deviceboot/>
Nov 16 19:17:39 user nova-compute[86931]:       <disksnapshot default='on' toggle='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     </features>
Nov 16 19:17:39 user nova-compute[86931]:   </guest>
Nov 16 19:17:39 user nova-compute[86931]: </capabilities>
Nov 16 19:17:39 user nova-compute[86931]: 
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-q35-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>i686</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='288'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'/>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='lm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-i440fx-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>i686</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='255'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'/>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='lm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ide</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-q35-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>i686</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='288'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'/>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='lm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-i440fx-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>i686</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='255'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'/>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='lm'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ide</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-q35-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>x86_64</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='288'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>efi</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='invtsc'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='rsba'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-i440fx-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>x86_64</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='255'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>efi</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='invtsc'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='rsba'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ide</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-q35-jammy</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>x86_64</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='288'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>efi</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='invtsc'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='rsba'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 19:17:39 user nova-compute[86931]: <domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 19:17:39 user nova-compute[86931]:   <domain>kvm</domain>
Nov 16 19:17:39 user nova-compute[86931]:   <machine>pc-i440fx-6.2</machine>
Nov 16 19:17:39 user nova-compute[86931]:   <arch>x86_64</arch>
Nov 16 19:17:39 user nova-compute[86931]:   <vcpu max='255'/>
Nov 16 19:17:39 user nova-compute[86931]:   <iothreads supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:   <os supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='firmware'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>efi</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:     <loader supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>rom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pflash</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='readonly'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>yes</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='secure'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>no</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </loader>
Nov 16 19:17:39 user nova-compute[86931]:   </os>
Nov 16 19:17:39 user nova-compute[86931]:   <cpu>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-passthrough' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='hostPassthroughMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='maximum' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='maximumMigratable'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>on</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>off</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='host-model' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <vendor>Intel</vendor>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ss'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='vmx'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pcid'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='hypervisor'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arat'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='umip'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='md-clear'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='invtsc'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibpb'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='ibrs'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-stibp'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='rsba'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='erms'/>
Nov 16 19:17:39 user nova-compute[86931]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:     <mode name='custom' supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>qemu64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>qemu32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>phenom</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>pentium</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>n270</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm64</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>kvm32</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>coreduo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>core2duo</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>athlon</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Westmere</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Snowridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Skylake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>SandyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Penryn</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G5</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G4</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G3</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Opteron_G2</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Opteron_G1</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>IvyBridge</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Icelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Haswell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Rome</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-Milan</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>EPYC</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Dhyana</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cooperlake</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>Conroe</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='no'>Broadwell</model>
Nov 16 19:17:39 user nova-compute[86931]:       <model usable='yes'>486</model>
Nov 16 19:17:39 user nova-compute[86931]:     </mode>
Nov 16 19:17:39 user nova-compute[86931]:   </cpu>
Nov 16 19:17:39 user nova-compute[86931]:   <memoryBacking supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:     <enum name='sourceType'>
Nov 16 19:17:39 user nova-compute[86931]:       <value>file</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>anonymous</value>
Nov 16 19:17:39 user nova-compute[86931]:       <value>memfd</value>
Nov 16 19:17:39 user nova-compute[86931]:     </enum>
Nov 16 19:17:39 user nova-compute[86931]:   </memoryBacking>
Nov 16 19:17:39 user nova-compute[86931]:   <devices>
Nov 16 19:17:39 user nova-compute[86931]:     <disk supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='diskDevice'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>disk</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cdrom</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>floppy</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>lun</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='bus'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ide</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>fdc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sata</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </disk>
Nov 16 19:17:39 user nova-compute[86931]:     <graphics supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='type'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>sdl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vnc</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>spice</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egl-headless</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </graphics>
Nov 16 19:17:39 user nova-compute[86931]:     <video supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='modelType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>cirrus</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>vmvga</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>qxl</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>none</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>bochs</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>ramfb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </video>
Nov 16 19:17:39 user nova-compute[86931]:     <hostdev supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='mode'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>subsystem</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='startupPolicy'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>default</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>mandatory</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>requisite</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>optional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='subsysType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>usb</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>pci</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>scsi</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='capsType'/>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='pciBackend'/>
Nov 16 19:17:39 user nova-compute[86931]:     </hostdev>
Nov 16 19:17:39 user nova-compute[86931]:     <rng supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtio-non-transitional</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>random</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>egd</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>builtin</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </rng>
Nov 16 19:17:39 user nova-compute[86931]:     <filesystem supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='driverType'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>path</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>handle</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>virtiofs</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </filesystem>
Nov 16 19:17:39 user nova-compute[86931]:     <tpm supported='yes'>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='model'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-tis</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>tpm-crb</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:       <enum name='backendModel'>
Nov 16 19:17:39 user nova-compute[86931]:         <value>passthrough</value>
Nov 16 19:17:39 user nova-compute[86931]:         <value>emulator</value>
Nov 16 19:17:39 user nova-compute[86931]:       </enum>
Nov 16 19:17:39 user nova-compute[86931]:     </tpm>
Nov 16 19:17:39 user nova-compute[86931]:   </devices>
Nov 16 19:17:39 user nova-compute[86931]:   <features>
Nov 16 19:17:39 user nova-compute[86931]:     <gic supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:     <vmcoreinfo supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <genid supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backingStoreInput supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <backup supported='yes'/>
Nov 16 19:17:39 user nova-compute[86931]:     <sev supported='no'/>
Nov 16 19:17:39 user nova-compute[86931]:   </features>
Nov 16 19:17:39 user nova-compute[86931]: </domainCapabilities>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=86931) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=86931) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Checking secure boot support for host arch (x86_64) {{(pid=86931) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 19:17:39 user nova-compute[86931]: INFO nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Secure Boot support detected
Nov 16 19:17:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] cpu compare xml: <cpu match="exact">
Nov 16 19:17:39 user nova-compute[86931]:   <model>Nehalem</model>
Nov 16 19:17:39 user nova-compute[86931]: </cpu>
Nov 16 19:17:39 user nova-compute[86931]:  {{(pid=86931) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 19:17:39 user nova-compute[86931]: INFO nova.virt.node [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Generated node identity 3324bc2c-db45-464f-b02b-15105785d59f
Nov 16 19:17:39 user nova-compute[86931]: INFO nova.virt.node [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Wrote node identity 3324bc2c-db45-464f-b02b-15105785d59f to /opt/stack/data/nova/compute_id
Nov 16 19:17:39 user nova-compute[86931]: WARNING nova.compute.manager [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Compute nodes ['3324bc2c-db45-464f-b02b-15105785d59f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 19:17:39 user nova-compute[86931]: INFO nova.compute.manager [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 19:17:40 user nova-compute[86931]: WARNING nova.compute.manager [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:17:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:17:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Hypervisor/Node resource view: name=user free_ram=10957MB free_disk=26.20284652709961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:17:40 user nova-compute[86931]: WARNING nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] No compute node record for user:3324bc2c-db45-464f-b02b-15105785d59f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3324bc2c-db45-464f-b02b-15105785d59f could not be found.
Nov 16 19:17:40 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Compute node record created for user:user with uuid: 3324bc2c-db45-464f-b02b-15105785d59f
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:17:40 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] [req-c9c994bf-edd3-4091-8e3c-b2cf1940e105] Created resource provider record via placement API for resource provider with UUID 3324bc2c-db45-464f-b02b-15105785d59f and name user.
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=86931) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 19:17:40 user nova-compute[86931]: INFO nova.virt.libvirt.host [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] kernel doesn't support AMD SEV
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Libvirt baseline CPU <cpu>
Nov 16 19:17:40 user nova-compute[86931]:   <arch>x86_64</arch>
Nov 16 19:17:40 user nova-compute[86931]:   <model>Nehalem</model>
Nov 16 19:17:40 user nova-compute[86931]:   <vendor>Intel</vendor>
Nov 16 19:17:40 user nova-compute[86931]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 19:17:40 user nova-compute[86931]: </cpu>
Nov 16 19:17:40 user nova-compute[86931]:  {{(pid=86931) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Updated inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Updating resource provider 3324bc2c-db45-464f-b02b-15105785d59f generation from 0 to 1 during operation: update_inventory {{(pid=86931) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Updating resource provider 3324bc2c-db45-464f-b02b-15105785d59f generation from 1 to 2 during operation: update_traits {{(pid=86931) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.service [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Creating RPC server for service compute {{(pid=86931) start /opt/stack/nova/nova/service.py:182}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.service [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] Join ServiceGroup membership for this service compute {{(pid=86931) start /opt/stack/nova/nova/service.py:199}}
Nov 16 19:17:40 user nova-compute[86931]: DEBUG nova.servicegroup.drivers.db [None req-dba5145a-c3fe-4526-a036-f9dbdf4ca626 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=86931) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 19:17:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:17:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:18:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:18:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:18:31 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=26.10662841796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:18:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:18:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:19:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:19:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:19:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:19:33 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=10313MB free_disk=26.17090606689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:19:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:19:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:20:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:20:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:20:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:20:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=10307MB free_disk=25.92331314086914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:20:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:20:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:21:35 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:35 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9633MB free_disk=25.94412612915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:21:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:21:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:21:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:21:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:21:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:21:42 user nova-compute[86931]: INFO nova.compute.claims [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Claim successful on node user
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:21:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:21:42 user nova-compute[86931]: INFO nova.compute.claims [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Claim successful on node user
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:21:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Creating image(s)
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "/opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "/opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "/opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:21:42 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.policy [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00bb9410e0b740d2a60f9918e956c57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fc58e1aecf84b5881a9b6188eaed5e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.part --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.virt.images [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] 04ef6bdb-1977-4f57-a0fb-6742ffba000b was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.part /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.part /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.converted" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:21:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Creating image(s)
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG nova.policy [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '608adfbbb5d74367a409c645ee871f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfa544a56b847afbf03a50f1e7603f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.074s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:43 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6o9_1_4l/privsep.sock']
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.161s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:44 user sudo[96182]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6o9_1_4l/privsep.sock
Nov 16 19:21:44 user sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:21:44 user nova-compute[86931]: INFO nova.compute.claims [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Claim successful on node user
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Successfully created port: 0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:21:45 user sudo[96182]: pam_unix(sudo:session): session closed for user root
Nov 16 19:21:45 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Spawned new privsep daemon via rootwrap
Nov 16 19:21:45 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 19:21:45 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 19:21:45 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 19:21:45 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96190
Nov 16 19:21:45 user nova-compute[86931]: WARNING oslo_privsep.priv_context [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] privsep daemon already running
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:21:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Creating image(s)
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:21:45 user nova-compute[86931]: INFO nova.compute.claims [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Claim successful on node user
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk 1073741824" returned: 0 in 0.044s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.policy [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c74086febf834740bbe6d094ebad864b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823d93d9aed54ef0aac913d3707f207f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.214s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.227s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.166s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.218s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk 1073741824" returned: 0 in 0.048s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.275s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Cannot resize image /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Ensure instance console log exists: /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Successfully created port: 81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:21:46 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.279s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk 1073741824" returned: 0 in 0.066s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Cannot resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Ensure instance console log exists: /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:21:46 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Creating image(s)
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "/opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.policy [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c8c15e0597f411f81270cd3b181043b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97456514d9f541ec936e509c558e60db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.226s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:21:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Cannot resize image /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Ensure instance console log exists: /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk 1073741824" returned: 0 in 0.089s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Cannot resize image /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Ensure instance console log exists: /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:21:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Successfully updated port: 0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquired lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Successfully created port: d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-changed-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Refreshing instance network info cache due to event network-changed-0bd1df0e-a81e-41da-ba09-307bcf547438. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] Acquiring lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Successfully updated port: 81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-changed-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Refreshing instance network info cache due to event network-changed-81b4eea3-5c4e-4a28-8c21-51adc18be286. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Successfully created port: 98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance network_info: |[{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.network.neutron [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Refreshing network info cache for port 81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start _get_guest_xml network_info=[{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:21:49 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:49 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:21:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'pci_devices' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:21:50 user nova-compute[86931]:   <uuid>08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</uuid>
Nov 16 19:21:50 user nova-compute[86931]:   <name>instance-00000002</name>
Nov 16 19:21:50 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:21:50 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:21:50 user nova-compute[86931]:   <metadata>
Nov 16 19:21:50 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:21:50 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeTestJSON-server-617281987</nova:name>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:21:49</nova:creationTime>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:21:50 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:owner>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:user uuid="608adfbbb5d74367a409c645ee871f6c">tempest-AttachVolumeTestJSON-1412638370-project-member</nova:user>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:project uuid="3cfa544a56b847afbf03a50f1e7603f2">tempest-AttachVolumeTestJSON-1412638370</nova:project>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:owner>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:ports>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:port uuid="81b4eea3-5c4e-4a28-8c21-51adc18be286">
Nov 16 19:21:50 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:21:50 user nova-compute[86931]:         </nova:port>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:ports>
Nov 16 19:21:50 user nova-compute[86931]:     </nova:instance>
Nov 16 19:21:50 user nova-compute[86931]:   </metadata>
Nov 16 19:21:50 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:21:50 user nova-compute[86931]:     <system>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="serial">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="uuid">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:21:50 user nova-compute[86931]:     </system>
Nov 16 19:21:50 user nova-compute[86931]:   </sysinfo>
Nov 16 19:21:50 user nova-compute[86931]:   <os>
Nov 16 19:21:50 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:21:50 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:21:50 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:21:50 user nova-compute[86931]:   </os>
Nov 16 19:21:50 user nova-compute[86931]:   <features>
Nov 16 19:21:50 user nova-compute[86931]:     <acpi/>
Nov 16 19:21:50 user nova-compute[86931]:     <apic/>
Nov 16 19:21:50 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:21:50 user nova-compute[86931]:   </features>
Nov 16 19:21:50 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:21:50 user nova-compute[86931]:   </clock>
Nov 16 19:21:50 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:21:50 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:21:50 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:21:50 user nova-compute[86931]:   </cpu>
Nov 16 19:21:50 user nova-compute[86931]:   <devices>
Nov 16 19:21:50 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:21:50 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:21:50 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk"/>
Nov 16 19:21:50 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:     </disk>
Nov 16 19:21:50 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:21:50 user nova-compute[86931]:       <mac address="fa:16:3e:00:91:45"/>
Nov 16 19:21:50 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:21:50 user nova-compute[86931]:       <target dev="tap81b4eea3-5c"/>
Nov 16 19:21:50 user nova-compute[86931]:     </interface>
Nov 16 19:21:50 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:21:50 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/console.log" append="off"/>
Nov 16 19:21:50 user nova-compute[86931]:     </serial>
Nov 16 19:21:50 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:21:50 user nova-compute[86931]:     <video>
Nov 16 19:21:50 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:     </video>
Nov 16 19:21:50 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:21:50 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:21:50 user nova-compute[86931]:     </rng>
Nov 16 19:21:50 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:21:50 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:21:50 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:21:50 user nova-compute[86931]:     </memballoon>
Nov 16 19:21:50 user nova-compute[86931]:   </devices>
Nov 16 19:21:50 user nova-compute[86931]: </domain>
Nov 16 19:21:50 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG os_vif [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Created schema index Interface.name {{(pid=86931) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Created schema index Port.name {{(pid=86931) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Created schema index Bridge.name {{(pid=86931) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [POLLOUT] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '313f2824-128d-59aa-a037-c3faadf5b381', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:50 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprys_ft2x/privsep.sock']
Nov 16 19:21:50 user sudo[96261]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprys_ft2x/privsep.sock
Nov 16 19:21:50 user sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating instance_info_cache with network_info: [{"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Releasing lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Instance network_info: |[{"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] Acquired lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Refreshing network info cache for port 0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Start _get_guest_xml network_info=[{"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:21:50 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:50 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114741729',display_name='tempest-DeleteServersTestJSON-server-2114741729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114741729',id=1,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc58e1aecf84b5881a9b6188eaed5e3',ramdisk_id='',reservation_id='r-i8gzhdc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1819981616',owner_user_name='tempest-DeleteServersTestJSON-1819981616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:43Z,user_data=None,user_id='00bb9410e0b740d2a60f9918e956c57b',uuid=c889eb11-5eb7-4a34-aaf2-82664139b729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converting VIF {"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lazy-loading 'pci_devices' on Instance uuid c889eb11-5eb7-4a34-aaf2-82664139b729 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:21:50 user nova-compute[86931]:   <uuid>c889eb11-5eb7-4a34-aaf2-82664139b729</uuid>
Nov 16 19:21:50 user nova-compute[86931]:   <name>instance-00000001</name>
Nov 16 19:21:50 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:21:50 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:21:50 user nova-compute[86931]:   <metadata>
Nov 16 19:21:50 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:21:50 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:name>tempest-DeleteServersTestJSON-server-2114741729</nova:name>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:21:50</nova:creationTime>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:21:50 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:owner>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:user uuid="00bb9410e0b740d2a60f9918e956c57b">tempest-DeleteServersTestJSON-1819981616-project-member</nova:user>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:project uuid="4fc58e1aecf84b5881a9b6188eaed5e3">tempest-DeleteServersTestJSON-1819981616</nova:project>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:owner>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:21:50 user nova-compute[86931]:       <nova:ports>
Nov 16 19:21:50 user nova-compute[86931]:         <nova:port uuid="0bd1df0e-a81e-41da-ba09-307bcf547438">
Nov 16 19:21:50 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:21:50 user nova-compute[86931]:         </nova:port>
Nov 16 19:21:50 user nova-compute[86931]:       </nova:ports>
Nov 16 19:21:50 user nova-compute[86931]:     </nova:instance>
Nov 16 19:21:50 user nova-compute[86931]:   </metadata>
Nov 16 19:21:50 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:21:50 user nova-compute[86931]:     <system>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="serial">c889eb11-5eb7-4a34-aaf2-82664139b729</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="uuid">c889eb11-5eb7-4a34-aaf2-82664139b729</entry>
Nov 16 19:21:50 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:21:50 user nova-compute[86931]:     </system>
Nov 16 19:21:50 user nova-compute[86931]:   </sysinfo>
Nov 16 19:21:50 user nova-compute[86931]:   <os>
Nov 16 19:21:50 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:21:50 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:21:50 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:21:50 user nova-compute[86931]:   </os>
Nov 16 19:21:50 user nova-compute[86931]:   <features>
Nov 16 19:21:50 user nova-compute[86931]:     <acpi/>
Nov 16 19:21:50 user nova-compute[86931]:     <apic/>
Nov 16 19:21:50 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:21:50 user nova-compute[86931]:   </features>
Nov 16 19:21:50 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:21:50 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:21:50 user nova-compute[86931]:   </clock>
Nov 16 19:21:50 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:21:50 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:21:50 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:21:50 user nova-compute[86931]:   </cpu>
Nov 16 19:21:50 user nova-compute[86931]:   <devices>
Nov 16 19:21:50 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:21:50 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:21:50 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk"/>
Nov 16 19:21:50 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:     </disk>
Nov 16 19:21:50 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:21:50 user nova-compute[86931]:       <mac address="fa:16:3e:ff:f3:3e"/>
Nov 16 19:21:50 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:21:50 user nova-compute[86931]:       <target dev="tap0bd1df0e-a8"/>
Nov 16 19:21:50 user nova-compute[86931]:     </interface>
Nov 16 19:21:50 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:21:50 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/console.log" append="off"/>
Nov 16 19:21:50 user nova-compute[86931]:     </serial>
Nov 16 19:21:50 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:21:50 user nova-compute[86931]:     <video>
Nov 16 19:21:50 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:50 user nova-compute[86931]:     </video>
Nov 16 19:21:50 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:21:50 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:21:50 user nova-compute[86931]:     </rng>
Nov 16 19:21:50 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:21:50 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:21:50 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:21:50 user nova-compute[86931]:     </memballoon>
Nov 16 19:21:50 user nova-compute[86931]:   </devices>
Nov 16 19:21:50 user nova-compute[86931]: </domain>
Nov 16 19:21:50 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114741729',display_name='tempest-DeleteServersTestJSON-server-2114741729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114741729',id=1,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fc58e1aecf84b5881a9b6188eaed5e3',ramdisk_id='',reservation_id='r-i8gzhdc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1819981616',owner_user_name='tempest-DeleteServersTestJSON-1819981616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:43Z,user_data=None,user_id='00bb9410e0b740d2a60f9918e956c57b',uuid=c889eb11-5eb7-4a34-aaf2-82664139b729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converting VIF {"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG os_vif [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '877a668a-9070-5bc1-a1ef-966c64771a2d', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Successfully updated port: d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:21:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updated VIF entry in instance network info cache for port 81b4eea3-5c4e-4a28-8c21-51adc18be286. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-719ef560-78ac-4e9b-a77a-4868a1a00a94 req-1f7b2c89-3a4a-438a-ace0-ee028bef7c81 service nova] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Instance network_info: |[{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Start _get_guest_xml network_info=[{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:21:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1781516197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1781516197',id=4,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-k8m1l0pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:47Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=afe35609-1004-4958-9893-d82894b6f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid afe35609-1004-4958-9893-d82894b6f297 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-changed-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Refreshing instance network info cache due to event network-changed-d18e7a7a-3764-4020-bf58-2cea6a96a0c2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] Acquiring lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] Acquired lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Refreshing network info cache for port d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:21:51 user nova-compute[86931]:   <uuid>afe35609-1004-4958-9893-d82894b6f297</uuid>
Nov 16 19:21:51 user nova-compute[86931]:   <name>instance-00000004</name>
Nov 16 19:21:51 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:21:51 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:21:51 user nova-compute[86931]:   <metadata>
Nov 16 19:21:51 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:21:51 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1781516197</nova:name>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:21:51</nova:creationTime>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:21:51 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:21:51 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:owner>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:21:51 user nova-compute[86931]:       </nova:owner>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:21:51 user nova-compute[86931]:       <nova:ports>
Nov 16 19:21:51 user nova-compute[86931]:         <nova:port uuid="d18e7a7a-3764-4020-bf58-2cea6a96a0c2">
Nov 16 19:21:51 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:21:51 user nova-compute[86931]:         </nova:port>
Nov 16 19:21:51 user nova-compute[86931]:       </nova:ports>
Nov 16 19:21:51 user nova-compute[86931]:     </nova:instance>
Nov 16 19:21:51 user nova-compute[86931]:   </metadata>
Nov 16 19:21:51 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:21:51 user nova-compute[86931]:     <system>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="serial">afe35609-1004-4958-9893-d82894b6f297</entry>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="uuid">afe35609-1004-4958-9893-d82894b6f297</entry>
Nov 16 19:21:51 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:21:51 user nova-compute[86931]:     </system>
Nov 16 19:21:51 user nova-compute[86931]:   </sysinfo>
Nov 16 19:21:51 user nova-compute[86931]:   <os>
Nov 16 19:21:51 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:21:51 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:21:51 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:21:51 user nova-compute[86931]:   </os>
Nov 16 19:21:51 user nova-compute[86931]:   <features>
Nov 16 19:21:51 user nova-compute[86931]:     <acpi/>
Nov 16 19:21:51 user nova-compute[86931]:     <apic/>
Nov 16 19:21:51 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:21:51 user nova-compute[86931]:   </features>
Nov 16 19:21:51 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:21:51 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:21:51 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:21:51 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:21:51 user nova-compute[86931]:   </clock>
Nov 16 19:21:51 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:21:51 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:21:51 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:21:51 user nova-compute[86931]:   </cpu>
Nov 16 19:21:51 user nova-compute[86931]:   <devices>
Nov 16 19:21:51 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:21:51 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:21:51 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk"/>
Nov 16 19:21:51 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:21:51 user nova-compute[86931]:     </disk>
Nov 16 19:21:51 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:21:51 user nova-compute[86931]:       <mac address="fa:16:3e:58:04:8c"/>
Nov 16 19:21:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:51 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:21:51 user nova-compute[86931]:       <target dev="tapd18e7a7a-37"/>
Nov 16 19:21:51 user nova-compute[86931]:     </interface>
Nov 16 19:21:51 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:21:51 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/console.log" append="off"/>
Nov 16 19:21:51 user nova-compute[86931]:     </serial>
Nov 16 19:21:51 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:21:51 user nova-compute[86931]:     <video>
Nov 16 19:21:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:51 user nova-compute[86931]:     </video>
Nov 16 19:21:51 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:21:51 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:21:51 user nova-compute[86931]:     </rng>
Nov 16 19:21:51 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:21:51 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:21:51 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:21:51 user nova-compute[86931]:     </memballoon>
Nov 16 19:21:51 user nova-compute[86931]:   </devices>
Nov 16 19:21:51 user nova-compute[86931]: </domain>
Nov 16 19:21:51 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1781516197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1781516197',id=4,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-k8m1l0pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:47Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=afe35609-1004-4958-9893-d82894b6f297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG os_vif [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a17335d2-245c-5a85-873e-d340003fbaac', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:51 user sudo[96261]: pam_unix(sudo:session): session closed for user root
Nov 16 19:21:51 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Spawned new privsep daemon via rootwrap
Nov 16 19:21:51 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 19:21:51 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 19:21:51 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 19:21:51 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96264
Nov 16 19:21:51 user nova-compute[86931]: WARNING oslo_privsep.priv_context [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] privsep daemon already running
Nov 16 19:21:51 user nova-compute[86931]: WARNING oslo_privsep.priv_context [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] privsep daemon already running
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updated VIF entry in instance network info cache for port 0bd1df0e-a81e-41da-ba09-307bcf547438. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating instance_info_cache with network_info: [{"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-63fb31b8-0e16-4008-ba6c-47ef8399cd82 req-bfce3e30-1d99-49ea-8c8c-05834f89bfff service nova] Releasing lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bd1df0e-a8, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bd1df0e-a8, col_values=(('qos', UUID('a369c8c9-07fc-4a86-84e4-20b6afb3ddb8')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bd1df0e-a8, col_values=(('external_ids', {'iface-id': '0bd1df0e-a81e-41da-ba09-307bcf547438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:f3:3e', 'vm-uuid': 'c889eb11-5eb7-4a34-aaf2-82664139b729'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: INFO os_vif [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8')
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd18e7a7a-37, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd18e7a7a-37, col_values=(('qos', UUID('d6600f5d-284a-4f92-9dad-a6916352814b')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd18e7a7a-37, col_values=(('external_ids', {'iface-id': 'd18e7a7a-3764-4020-bf58-2cea6a96a0c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:04:8c', 'vm-uuid': 'afe35609-1004-4958-9893-d82894b6f297'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Updated VIF entry in instance network info cache for port d18e7a7a-3764-4020-bf58-2cea6a96a0c2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: INFO os_vif [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37')
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b4eea3-5c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81b4eea3-5c, col_values=(('qos', UUID('dfcd381a-d940-4ce3-8bdf-2b89c7967632')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81b4eea3-5c, col_values=(('external_ids', {'iface-id': '81b4eea3-5c4e-4a28-8c21-51adc18be286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:91:45', 'vm-uuid': '08ef1b8a-6ff3-4322-b9ea-7ca7e838a829'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8977a9fa-a502-4fce-bce2-9edca2657a76 req-2b557969-fdfd-428b-9652-9d765f319466 service nova] Releasing lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:52 user nova-compute[86931]: INFO os_vif [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] No VIF found with MAC fa:16:3e:ff:f3:3e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:58:04:8c, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No VIF found with MAC fa:16:3e:00:91:45, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Successfully updated port: 98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing instance network info cache due to event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:21:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Instance network_info: |[{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Start _get_guest_xml network_info=[{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:21:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230297822',display_name='tempest-ServerActionsTestOtherA-server-230297822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230297822',id=3,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-vfohyurd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=8d74eef2-f3a7-4063-95a5-4f13304c9d8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.objects.instance [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d74eef2-f3a7-4063-95a5-4f13304c9d8f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:21:53 user nova-compute[86931]:   <uuid>8d74eef2-f3a7-4063-95a5-4f13304c9d8f</uuid>
Nov 16 19:21:53 user nova-compute[86931]:   <name>instance-00000003</name>
Nov 16 19:21:53 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:21:53 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:21:53 user nova-compute[86931]:   <metadata>
Nov 16 19:21:53 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:21:53 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherA-server-230297822</nova:name>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:21:53</nova:creationTime>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:21:53 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:21:53 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:owner>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:user uuid="c74086febf834740bbe6d094ebad864b">tempest-ServerActionsTestOtherA-672558396-project-member</nova:user>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:project uuid="823d93d9aed54ef0aac913d3707f207f">tempest-ServerActionsTestOtherA-672558396</nova:project>
Nov 16 19:21:53 user nova-compute[86931]:       </nova:owner>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:21:53 user nova-compute[86931]:       <nova:ports>
Nov 16 19:21:53 user nova-compute[86931]:         <nova:port uuid="98c5d767-24e5-4f04-983e-d217b97d29e6">
Nov 16 19:21:53 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 19:21:53 user nova-compute[86931]:         </nova:port>
Nov 16 19:21:53 user nova-compute[86931]:       </nova:ports>
Nov 16 19:21:53 user nova-compute[86931]:     </nova:instance>
Nov 16 19:21:53 user nova-compute[86931]:   </metadata>
Nov 16 19:21:53 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:21:53 user nova-compute[86931]:     <system>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="serial">8d74eef2-f3a7-4063-95a5-4f13304c9d8f</entry>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="uuid">8d74eef2-f3a7-4063-95a5-4f13304c9d8f</entry>
Nov 16 19:21:53 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:21:53 user nova-compute[86931]:     </system>
Nov 16 19:21:53 user nova-compute[86931]:   </sysinfo>
Nov 16 19:21:53 user nova-compute[86931]:   <os>
Nov 16 19:21:53 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:21:53 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:21:53 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:21:53 user nova-compute[86931]:   </os>
Nov 16 19:21:53 user nova-compute[86931]:   <features>
Nov 16 19:21:53 user nova-compute[86931]:     <acpi/>
Nov 16 19:21:53 user nova-compute[86931]:     <apic/>
Nov 16 19:21:53 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:21:53 user nova-compute[86931]:   </features>
Nov 16 19:21:53 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:21:53 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:21:53 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:21:53 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:21:53 user nova-compute[86931]:   </clock>
Nov 16 19:21:53 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:21:53 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:21:53 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:21:53 user nova-compute[86931]:   </cpu>
Nov 16 19:21:53 user nova-compute[86931]:   <devices>
Nov 16 19:21:53 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:21:53 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:21:53 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk"/>
Nov 16 19:21:53 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:21:53 user nova-compute[86931]:     </disk>
Nov 16 19:21:53 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:21:53 user nova-compute[86931]:       <mac address="fa:16:3e:8f:ac:60"/>
Nov 16 19:21:53 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:53 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:21:53 user nova-compute[86931]:       <target dev="tap98c5d767-24"/>
Nov 16 19:21:53 user nova-compute[86931]:     </interface>
Nov 16 19:21:53 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:21:53 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/console.log" append="off"/>
Nov 16 19:21:53 user nova-compute[86931]:     </serial>
Nov 16 19:21:53 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:21:53 user nova-compute[86931]:     <video>
Nov 16 19:21:53 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:21:53 user nova-compute[86931]:     </video>
Nov 16 19:21:53 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:21:53 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:21:53 user nova-compute[86931]:     </rng>
Nov 16 19:21:53 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:21:53 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:21:53 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:21:53 user nova-compute[86931]:     </memballoon>
Nov 16 19:21:53 user nova-compute[86931]:   </devices>
Nov 16 19:21:53 user nova-compute[86931]: </domain>
Nov 16 19:21:53 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230297822',display_name='tempest-ServerActionsTestOtherA-server-230297822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230297822',id=3,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-vfohyurd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=8d74eef2-f3a7-4063-95a5-4f13304c9d8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG os_vif [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd7c38ec-fbfb-53ce-a612-81912ed66dd7', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98c5d767-24, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98c5d767-24, col_values=(('qos', UUID('197ac624-74c8-4ba2-8664-848fee4afcde')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98c5d767-24, col_values=(('external_ids', {'iface-id': '98c5d767-24e5-4f04-983e-d217b97d29e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ac:60', 'vm-uuid': '8d74eef2-f3a7-4063-95a5-4f13304c9d8f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:53 user nova-compute[86931]: INFO os_vif [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24')
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:8f:ac:60, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated VIF entry in instance network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:21:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d17edcd-6372-4b72-8414-34b903f236aa req-a89dcc54-8c3e-4e07-a34b-4ae5f50ff80a service nova] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:21:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:21:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance spawned successfully.
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Instance spawned successfully.
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:21:59 user nova-compute[86931]: INFO nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Took 16.09 seconds to spawn the instance on the hypervisor.
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:21:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Instance spawned successfully.
Nov 16 19:21:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Took 17.12 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Took 17.38 seconds to build instance.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3f9b4a1-5bb2-4701-beb0-a6cd00a5fa46 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.524s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Took 14.25 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Took 18.25 seconds to build instance.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-76797f96-698c-4521-968b-ee99e2814d5b tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.653s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Took 15.47 seconds to build instance.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-003990f6-e956-4b7a-a8c0-9f469df2be66 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.618s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: afe35609-1004-4958-9893-d82894b6f297] Instance spawned successfully.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Took 13.79 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:00 user nova-compute[86931]: INFO nova.compute.manager [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Took 15.06 seconds to build instance.
Nov 16 19:22:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9417277-f119-431a-ba63-dbcc351a41dd tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.237s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:01 user nova-compute[86931]: INFO nova.compute.claims [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Claim successful on node user
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] No waiting events found dispatching network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:02 user nova-compute[86931]: WARNING nova.compute.manager [req-2dc8c092-9221-4bd5-91b8-488673cf6d66 req-efe2eb42-a286-41d5-b6a4-4dee831b2bd9 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received unexpected event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 for instance with vm_state active and task_state None.
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Creating image(s)
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "/opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "/opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "/opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:02 user nova-compute[86931]: DEBUG nova.policy [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '314dbeab5ae5441a813eebc5e6e24c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bf618b6c25f4e89b89d837f91df2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.291s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.262s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk 1073741824" returned: 0 in 0.066s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.264s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:22:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Cannot resize image /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Ensure instance console log exists: /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] No waiting events found dispatching network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:04 user nova-compute[86931]: WARNING nova.compute.manager [req-bb1de049-cc96-4f9b-b866-760eddf8f66a req-e1a49a37-e492-402c-9c91-b003bba9cb63 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received unexpected event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 for instance with vm_state active and task_state None.
Nov 16 19:22:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Successfully created port: a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Successfully updated port: a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquired lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-changed-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Refreshing instance network info cache due to event network-changed-a81af5e5-4748-4c34-887a-5988dfde05ab. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] Acquiring lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating instance_info_cache with network_info: [{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Releasing lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Instance network_info: |[{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] Acquired lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Refreshing network info cache for port a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Start _get_guest_xml network_info=[{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:08 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:08 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1560785364',display_name='tempest-VolumesAdminNegativeTest-server-1560785364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1560785364',id=5,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5G0zWBd4f373VyJJlEoeM+kAa8z/GU0lKdJeDfcajIgetPWnrz9IX+yNIxVRQx8duZkp5Ezjwx8A7Jzd93vl2VRf7DewA9sDPrC3bVIxE0oiyO/9BKD9kaYGvWLZ8SHw==',key_name='tempest-keypair-1373246192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-422qbe3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=e16458c7-133e-4424-bc89-018f28f6a546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'pci_devices' on Instance uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:08 user nova-compute[86931]:   <uuid>e16458c7-133e-4424-bc89-018f28f6a546</uuid>
Nov 16 19:22:08 user nova-compute[86931]:   <name>instance-00000005</name>
Nov 16 19:22:08 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:08 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:08 user nova-compute[86931]:   <metadata>
Nov 16 19:22:08 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:08 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1560785364</nova:name>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:08</nova:creationTime>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:08 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:08 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:user uuid="314dbeab5ae5441a813eebc5e6e24c98">tempest-VolumesAdminNegativeTest-1956727884-project-member</nova:user>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:project uuid="5bf618b6c25f4e89b89d837f91df2063">tempest-VolumesAdminNegativeTest-1956727884</nova:project>
Nov 16 19:22:08 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:22:08 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:08 user nova-compute[86931]:         <nova:port uuid="a81af5e5-4748-4c34-887a-5988dfde05ab">
Nov 16 19:22:08 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:22:08 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:08 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:08 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:08 user nova-compute[86931]:   </metadata>
Nov 16 19:22:08 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:08 user nova-compute[86931]:     <system>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="serial">e16458c7-133e-4424-bc89-018f28f6a546</entry>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="uuid">e16458c7-133e-4424-bc89-018f28f6a546</entry>
Nov 16 19:22:08 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:08 user nova-compute[86931]:     </system>
Nov 16 19:22:08 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:08 user nova-compute[86931]:   <os>
Nov 16 19:22:08 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:08 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:08 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:08 user nova-compute[86931]:   </os>
Nov 16 19:22:08 user nova-compute[86931]:   <features>
Nov 16 19:22:08 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:08 user nova-compute[86931]:     <apic/>
Nov 16 19:22:08 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:08 user nova-compute[86931]:   </features>
Nov 16 19:22:08 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:08 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:08 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:08 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:08 user nova-compute[86931]:   </clock>
Nov 16 19:22:08 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:08 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:08 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:08 user nova-compute[86931]:   </cpu>
Nov 16 19:22:08 user nova-compute[86931]:   <devices>
Nov 16 19:22:08 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:22:08 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:22:08 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk"/>
Nov 16 19:22:08 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:22:08 user nova-compute[86931]:     </disk>
Nov 16 19:22:08 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:08 user nova-compute[86931]:       <mac address="fa:16:3e:05:bf:bd"/>
Nov 16 19:22:08 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:08 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:08 user nova-compute[86931]:       <target dev="tapa81af5e5-47"/>
Nov 16 19:22:08 user nova-compute[86931]:     </interface>
Nov 16 19:22:08 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:08 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/console.log" append="off"/>
Nov 16 19:22:08 user nova-compute[86931]:     </serial>
Nov 16 19:22:08 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:08 user nova-compute[86931]:     <video>
Nov 16 19:22:08 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:08 user nova-compute[86931]:     </video>
Nov 16 19:22:08 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:08 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:08 user nova-compute[86931]:     </rng>
Nov 16 19:22:08 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:08 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:08 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:08 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:08 user nova-compute[86931]:   </devices>
Nov 16 19:22:08 user nova-compute[86931]: </domain>
Nov 16 19:22:08 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1560785364',display_name='tempest-VolumesAdminNegativeTest-server-1560785364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1560785364',id=5,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5G0zWBd4f373VyJJlEoeM+kAa8z/GU0lKdJeDfcajIgetPWnrz9IX+yNIxVRQx8duZkp5Ezjwx8A7Jzd93vl2VRf7DewA9sDPrC3bVIxE0oiyO/9BKD9kaYGvWLZ8SHw==',key_name='tempest-keypair-1373246192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-422qbe3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=e16458c7-133e-4424-bc89-018f28f6a546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG os_vif [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7563ef0-083d-5b63-9c80-3c860c01fa32', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa81af5e5-47, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa81af5e5-47, col_values=(('qos', UUID('3c904fbe-60fc-4da4-8d60-8d00ab19a9cb')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa81af5e5-47, col_values=(('external_ids', {'iface-id': 'a81af5e5-4748-4c34-887a-5988dfde05ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:bf:bd', 'vm-uuid': 'e16458c7-133e-4424-bc89-018f28f6a546'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:08 user nova-compute[86931]: INFO os_vif [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47')
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No VIF found with MAC fa:16:3e:05:bf:bd, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updated VIF entry in instance network info cache for port a81af5e5-4748-4c34-887a-5988dfde05ab. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating instance_info_cache with network_info: [{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0a6762-f512-4f20-a444-08e1b26094e6 req-24fd114d-0e2e-4b38-b282-202a50f33b40 service nova] Releasing lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:09 user nova-compute[86931]: INFO nova.compute.claims [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Claim successful on node user
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG nova.policy [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25a76c9dee8244a6b30c7d0bd55dc908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7813f165270042ce84a735f3ae066f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Creating image(s)
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "/opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "/opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.296s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.361s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk 1073741824" returned: 0 in 0.159s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.529s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] No waiting events found dispatching network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:11 user nova-compute[86931]: WARNING nova.compute.manager [req-41768d81-f5e8-462c-a750-39fac4c521e8 req-61b1bd50-93e5-404a-82aa-c55e4a572b33 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received unexpected event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab for instance with vm_state building and task_state spawning.
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Successfully created port: 46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.341s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Cannot resize image /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Ensure instance console log exists: /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Successfully updated port: 46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquired lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-changed-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Refreshing instance network info cache due to event network-changed-46896ae9-01ff-4227-a74f-5d956d539d46. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] Acquiring lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] No waiting events found dispatching network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:13 user nova-compute[86931]: WARNING nova.compute.manager [req-cadb4785-e61e-4c9e-8ab2-f183b6f5374f req-0ee86fb9-b162-4697-b137-2eb24dfb55da service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received unexpected event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab for instance with vm_state building and task_state spawning.
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Instance spawned successfully.
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:13 user nova-compute[86931]: INFO nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Took 10.58 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updating instance_info_cache with network_info: [{"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Releasing lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Instance network_info: |[{"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] Acquired lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Refreshing network info cache for port 46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Start _get_guest_xml network_info=[{"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:13 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:13 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405950652',display_name='tempest-TestVolumeSwap-server-405950652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405950652',id=6,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd3rsGDx0tEGLEprkvlfOaeoCCiu/QmgI9BhfYpKxlIz8Z2WoxhYRflmnLrMAm5Adu0KfI6ZcI/AHRFLAVJq6vuuJJ97EL2PBtosczWBU+x0xYYIJzgWvQZLQdn4qkLYw==',key_name='tempest-keypair-1340648349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7813f165270042ce84a735f3ae066f8a',ramdisk_id='',reservation_id='r-r3811gbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1084200294',owner_user_name='tempest-TestVolumeSwap-1084200294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a76c9dee8244a6b30c7d0bd55dc908',uuid=b4834f6f-9cdd-450e-bf08-e49d353c3574,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converting VIF {"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lazy-loading 'pci_devices' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:13 user nova-compute[86931]:   <uuid>b4834f6f-9cdd-450e-bf08-e49d353c3574</uuid>
Nov 16 19:22:13 user nova-compute[86931]:   <name>instance-00000006</name>
Nov 16 19:22:13 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:13 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:13 user nova-compute[86931]:   <metadata>
Nov 16 19:22:13 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:13 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:name>tempest-TestVolumeSwap-server-405950652</nova:name>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:13</nova:creationTime>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:13 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:13 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:user uuid="25a76c9dee8244a6b30c7d0bd55dc908">tempest-TestVolumeSwap-1084200294-project-member</nova:user>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:project uuid="7813f165270042ce84a735f3ae066f8a">tempest-TestVolumeSwap-1084200294</nova:project>
Nov 16 19:22:13 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:22:13 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:13 user nova-compute[86931]:         <nova:port uuid="46896ae9-01ff-4227-a74f-5d956d539d46">
Nov 16 19:22:13 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:22:13 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:13 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:13 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:13 user nova-compute[86931]:   </metadata>
Nov 16 19:22:13 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:13 user nova-compute[86931]:     <system>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="serial">b4834f6f-9cdd-450e-bf08-e49d353c3574</entry>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="uuid">b4834f6f-9cdd-450e-bf08-e49d353c3574</entry>
Nov 16 19:22:13 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:13 user nova-compute[86931]:     </system>
Nov 16 19:22:13 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:13 user nova-compute[86931]:   <os>
Nov 16 19:22:13 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:13 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:13 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:13 user nova-compute[86931]:   </os>
Nov 16 19:22:13 user nova-compute[86931]:   <features>
Nov 16 19:22:13 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:13 user nova-compute[86931]:     <apic/>
Nov 16 19:22:13 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:13 user nova-compute[86931]:   </features>
Nov 16 19:22:13 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:13 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:13 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:13 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:13 user nova-compute[86931]:   </clock>
Nov 16 19:22:13 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:13 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:13 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:13 user nova-compute[86931]:   </cpu>
Nov 16 19:22:13 user nova-compute[86931]:   <devices>
Nov 16 19:22:13 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:22:13 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:22:13 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk"/>
Nov 16 19:22:13 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:22:13 user nova-compute[86931]:     </disk>
Nov 16 19:22:13 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:13 user nova-compute[86931]:       <mac address="fa:16:3e:02:1c:f3"/>
Nov 16 19:22:13 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:13 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:13 user nova-compute[86931]:       <target dev="tap46896ae9-01"/>
Nov 16 19:22:13 user nova-compute[86931]:     </interface>
Nov 16 19:22:13 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:13 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/console.log" append="off"/>
Nov 16 19:22:13 user nova-compute[86931]:     </serial>
Nov 16 19:22:13 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:13 user nova-compute[86931]:     <video>
Nov 16 19:22:13 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:13 user nova-compute[86931]:     </video>
Nov 16 19:22:13 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:13 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:13 user nova-compute[86931]:     </rng>
Nov 16 19:22:13 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:13 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:13 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:13 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:13 user nova-compute[86931]:   </devices>
Nov 16 19:22:13 user nova-compute[86931]: </domain>
Nov 16 19:22:13 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405950652',display_name='tempest-TestVolumeSwap-server-405950652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405950652',id=6,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd3rsGDx0tEGLEprkvlfOaeoCCiu/QmgI9BhfYpKxlIz8Z2WoxhYRflmnLrMAm5Adu0KfI6ZcI/AHRFLAVJq6vuuJJ97EL2PBtosczWBU+x0xYYIJzgWvQZLQdn4qkLYw==',key_name='tempest-keypair-1340648349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7813f165270042ce84a735f3ae066f8a',ramdisk_id='',reservation_id='r-r3811gbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1084200294',owner_user_name='tempest-TestVolumeSwap-1084200294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a76c9dee8244a6b30c7d0bd55dc908',uuid=b4834f6f-9cdd-450e-bf08-e49d353c3574,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converting VIF {"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG os_vif [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f2ad112-9dc3-5764-b9dc-412776372081', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46896ae9-01, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46896ae9-01, col_values=(('qos', UUID('5bab7dc5-485e-4ae9-aa31-329f3cc8fda7')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46896ae9-01, col_values=(('external_ids', {'iface-id': '46896ae9-01ff-4227-a74f-5d956d539d46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:1c:f3', 'vm-uuid': 'b4834f6f-9cdd-450e-bf08-e49d353c3574'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:13 user nova-compute[86931]: INFO os_vif [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01')
Nov 16 19:22:13 user nova-compute[86931]: INFO nova.compute.manager [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Took 11.95 seconds to build instance.
Nov 16 19:22:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5effd565-b252-4064-8019-019bd660778a tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.194s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] No VIF found with MAC fa:16:3e:02:1c:f3, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updated VIF entry in instance network info cache for port 46896ae9-01ff-4227-a74f-5d956d539d46. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updating instance_info_cache with network_info: [{"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-297a9c59-0347-4dc0-8aff-e35525fd1c53 req-14a17377-aec1-499c-b99e-a613206c1699 service nova] Releasing lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:15 user nova-compute[86931]: INFO nova.compute.claims [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Claim successful on node user
Nov 16 19:22:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.policy [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '650e415b8bee442f8e5ed3d35356042c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5196e040960b457983e45ae2a59d014d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Creating image(s)
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.part --force-share --output=json" returned: 0 in 0.309s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:17 user nova-compute[86931]: DEBUG nova.virt.images [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:22:17 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:22:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.part /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] No waiting events found dispatching network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:18 user nova-compute[86931]: WARNING nova.compute.manager [req-cecde3df-6743-4fc3-bd9a-9299c85a42de req-ce023c13-70ab-46a6-8a42-0fd94f8228c1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received unexpected event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 for instance with vm_state building and task_state spawning.
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.part /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.converted" returned: 0 in 0.571s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Successfully created port: 4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.787s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json" returned: 0 in 0.207s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Instance spawned successfully.
Nov 16 19:22:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:19 user nova-compute[86931]: INFO nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Took 8.86 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json" returned: 0 in 0.215s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9,backing_fmt=raw /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9,backing_fmt=raw /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk 1073741824" returned: 0 in 0.059s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "a9bcc6027c8cca695c1d042567d44bf1f15edde9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:19 user nova-compute[86931]: INFO nova.compute.manager [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Took 10.15 seconds to build instance.
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4cf57cfd-9ec1-4877-96a0-6731e7d92afe tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.315s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 --force-share --output=json" returned: 0 in 0.232s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Cannot resize image /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Ensure instance console log exists: /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Successfully updated port: 4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquired lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:19 user nova-compute[86931]: INFO nova.compute.claims [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Claim successful on node user
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updating instance_info_cache with network_info: [{"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Releasing lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Instance network_info: |[{"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Start _get_guest_xml network_info=[{"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:22:06Z,direct_url=<?>,disk_format='qcow2',id=fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f,min_disk=0,min_ram=0,name='',owner='e3c63983c7b449488369fc4e3562d1d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:22:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] No waiting events found dispatching network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:20 user nova-compute[86931]: WARNING nova.compute.manager [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received unexpected event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 for instance with vm_state active and task_state None.
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-changed-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Refreshing instance network info cache due to event network-changed-4b6e21ac-041b-49a7-a569-059d0e03d511. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Acquiring lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Acquired lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.neutron [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Refreshing network info cache for port 4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:22:06Z,direct_url=<?>,disk_format='qcow2',id=fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f,min_disk=0,min_ram=0,name='',owner='e3c63983c7b449488369fc4e3562d1d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:22:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2006905742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2006905742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2006905742',id=7,image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3WqYDR2ZeM9JTj7YlD8HE0+VbsRUup4lRRt/bvLqi94xNZN5dHI51/NBGACaB9ojaEPT5XM3a1lUx1Cc5L/0DeTAHLNIRDWD59PRok0JNIb7tPjZu5SKzuyHx2yO4fXg==',key_name='tempest-keypair-312958567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5196e040960b457983e45ae2a59d014d',ramdisk_id='',reservation_id='r-1gxfescb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150846559',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150846559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='650e415b8bee442f8e5ed3d35356042c',uuid=f36e7459-f870-4c1c-b45f-102a09370f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converting VIF {"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.objects.instance [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lazy-loading 'pci_devices' on Instance uuid f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:20 user nova-compute[86931]:   <uuid>f36e7459-f870-4c1c-b45f-102a09370f04</uuid>
Nov 16 19:22:20 user nova-compute[86931]:   <name>instance-00000007</name>
Nov 16 19:22:20 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:20 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:20 user nova-compute[86931]:   <metadata>
Nov 16 19:22:20 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:20 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2006905742</nova:name>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:20</nova:creationTime>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:20 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:20 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:user uuid="650e415b8bee442f8e5ed3d35356042c">tempest-AttachSCSIVolumeTestJSON-1150846559-project-member</nova:user>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:project uuid="5196e040960b457983e45ae2a59d014d">tempest-AttachSCSIVolumeTestJSON-1150846559</nova:project>
Nov 16 19:22:20 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:root type="image" uuid="fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f"/>
Nov 16 19:22:20 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:20 user nova-compute[86931]:         <nova:port uuid="4b6e21ac-041b-49a7-a569-059d0e03d511">
Nov 16 19:22:20 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:22:20 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:20 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:20 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:20 user nova-compute[86931]:   </metadata>
Nov 16 19:22:20 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:20 user nova-compute[86931]:     <system>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="serial">f36e7459-f870-4c1c-b45f-102a09370f04</entry>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="uuid">f36e7459-f870-4c1c-b45f-102a09370f04</entry>
Nov 16 19:22:20 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:20 user nova-compute[86931]:     </system>
Nov 16 19:22:20 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:20 user nova-compute[86931]:   <os>
Nov 16 19:22:20 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:20 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:20 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:20 user nova-compute[86931]:   </os>
Nov 16 19:22:20 user nova-compute[86931]:   <features>
Nov 16 19:22:20 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:20 user nova-compute[86931]:     <apic/>
Nov 16 19:22:20 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:20 user nova-compute[86931]:   </features>
Nov 16 19:22:20 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:20 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:20 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:20 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:20 user nova-compute[86931]:   </clock>
Nov 16 19:22:20 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:20 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:20 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:20 user nova-compute[86931]:   </cpu>
Nov 16 19:22:20 user nova-compute[86931]:   <devices>
Nov 16 19:22:20 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:22:20 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:22:20 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk"/>
Nov 16 19:22:20 user nova-compute[86931]:       <target dev="sda" bus="scsi"/>
Nov 16 19:22:20 user nova-compute[86931]:       <address type="drive" controller="0" unit="0"/>
Nov 16 19:22:20 user nova-compute[86931]:     </disk>
Nov 16 19:22:20 user nova-compute[86931]:     <disk type="file" device="cdrom">
Nov 16 19:22:20 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 19:22:20 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.config"/>
Nov 16 19:22:20 user nova-compute[86931]:       <target dev="sdb" bus="scsi"/>
Nov 16 19:22:20 user nova-compute[86931]:       <address type="drive" controller="0" unit="1"/>
Nov 16 19:22:20 user nova-compute[86931]:     </disk>
Nov 16 19:22:20 user nova-compute[86931]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 19:22:20 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:20 user nova-compute[86931]:       <mac address="fa:16:3e:69:98:36"/>
Nov 16 19:22:20 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:20 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:20 user nova-compute[86931]:       <target dev="tap4b6e21ac-04"/>
Nov 16 19:22:20 user nova-compute[86931]:     </interface>
Nov 16 19:22:20 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:20 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/console.log" append="off"/>
Nov 16 19:22:20 user nova-compute[86931]:     </serial>
Nov 16 19:22:20 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:20 user nova-compute[86931]:     <video>
Nov 16 19:22:20 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:20 user nova-compute[86931]:     </video>
Nov 16 19:22:20 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:20 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:20 user nova-compute[86931]:     </rng>
Nov 16 19:22:20 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:20 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:20 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:20 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:20 user nova-compute[86931]:   </devices>
Nov 16 19:22:20 user nova-compute[86931]: </domain>
Nov 16 19:22:20 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2006905742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2006905742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2006905742',id=7,image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3WqYDR2ZeM9JTj7YlD8HE0+VbsRUup4lRRt/bvLqi94xNZN5dHI51/NBGACaB9ojaEPT5XM3a1lUx1Cc5L/0DeTAHLNIRDWD59PRok0JNIb7tPjZu5SKzuyHx2yO4fXg==',key_name='tempest-keypair-312958567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5196e040960b457983e45ae2a59d014d',ramdisk_id='',reservation_id='r-1gxfescb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150846559',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150846559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='650e415b8bee442f8e5ed3d35356042c',uuid=f36e7459-f870-4c1c-b45f-102a09370f04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converting VIF {"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG os_vif [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59a856de-4d35-5da6-b7fe-7b113ed56de0', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b6e21ac-04, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b6e21ac-04, col_values=(('qos', UUID('e1032405-2fb6-46b3-a69a-5a30e2c4d2ff')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b6e21ac-04, col_values=(('external_ids', {'iface-id': '4b6e21ac-041b-49a7-a569-059d0e03d511', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:98:36', 'vm-uuid': 'f36e7459-f870-4c1c-b45f-102a09370f04'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:20 user nova-compute[86931]: INFO os_vif [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04')
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No BDM found with device name sda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No BDM found with device name sdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No VIF found with MAC fa:16:3e:69:98:36, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Using config drive
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Creating config drive at /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.config
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoagfe3tu {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpoagfe3tu" returned: 0 in 0.059s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.policy [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c6d9ee1c274f6fae59529b07f83b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c91d63d28847aa9d297f9c03c4af2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Creating image(s)
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updated VIF entry in instance network info cache for port 4b6e21ac-041b-49a7-a569-059d0e03d511. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updating instance_info_cache with network_info: [{"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3a3eb14d-ffda-4c4d-827e-d32b4fd20e23 req-5f6d4fc9-6e86-49f1-85ce-d9f403cd28b1 service nova] Releasing lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.263s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk 1073741824" returned: 0 in 0.059s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Successfully created port: 83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Cannot resize image /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Ensure instance console log exists: /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:22 user nova-compute[86931]: INFO nova.compute.claims [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Claim successful on node user
Nov 16 19:22:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] No waiting events found dispatching network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:22 user nova-compute[86931]: WARNING nova.compute.manager [req-ab21ceae-7918-4e59-862e-b5e8b4b73a23 req-6db9127a-523d-4f20-ad87-41f962006e73 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received unexpected event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 for instance with vm_state building and task_state spawning.
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Successfully updated port: 83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:23 user nova-compute[86931]: INFO nova.virt.block_device [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Booting with volume 0b692075-47b9-49ff-931a-c612d8ff61a5 at /dev/vda
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.policy [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8bd27ea76994ab5937a32f4d1ecc806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2255f38550244b2a37369cd6723f44a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG os_brick.utils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:22:23 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpnb08u9o0/privsep.sock']
Nov 16 19:22:23 user sudo[97477]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpnb08u9o0/privsep.sock
Nov 16 19:22:23 user sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:23 user nova-compute[86931]: INFO nova.compute.claims [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Claim successful on node user
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Instance network_info: |[{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Start _get_guest_xml network_info=[{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.objects.instance [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'pci_devices' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:24 user nova-compute[86931]:   <uuid>7269c7b0-d837-4201-8695-83eeb7c7824f</uuid>
Nov 16 19:22:24 user nova-compute[86931]:   <name>instance-00000008</name>
Nov 16 19:22:24 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:24 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:24 user nova-compute[86931]:   <metadata>
Nov 16 19:22:24 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:24 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:24</nova:creationTime>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:24 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:24 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:22:24 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:22:24 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:24 user nova-compute[86931]:         <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:22:24 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:22:24 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:24 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:24 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:24 user nova-compute[86931]:   </metadata>
Nov 16 19:22:24 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:24 user nova-compute[86931]:     <system>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="serial">7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="uuid">7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:22:24 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:24 user nova-compute[86931]:     </system>
Nov 16 19:22:24 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:24 user nova-compute[86931]:   <os>
Nov 16 19:22:24 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:24 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:24 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:24 user nova-compute[86931]:   </os>
Nov 16 19:22:24 user nova-compute[86931]:   <features>
Nov 16 19:22:24 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:24 user nova-compute[86931]:     <apic/>
Nov 16 19:22:24 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:24 user nova-compute[86931]:   </features>
Nov 16 19:22:24 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:24 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:24 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:24 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:24 user nova-compute[86931]:   </clock>
Nov 16 19:22:24 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:24 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:24 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:24 user nova-compute[86931]:   </cpu>
Nov 16 19:22:24 user nova-compute[86931]:   <devices>
Nov 16 19:22:24 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:22:24 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:22:24 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk"/>
Nov 16 19:22:24 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:22:24 user nova-compute[86931]:     </disk>
Nov 16 19:22:24 user nova-compute[86931]:     <disk type="file" device="cdrom">
Nov 16 19:22:24 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 19:22:24 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config"/>
Nov 16 19:22:24 user nova-compute[86931]:       <target dev="hda" bus="ide"/>
Nov 16 19:22:24 user nova-compute[86931]:     </disk>
Nov 16 19:22:24 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:24 user nova-compute[86931]:       <mac address="fa:16:3e:47:4f:09"/>
Nov 16 19:22:24 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:24 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:24 user nova-compute[86931]:       <target dev="tap83c9ef40-99"/>
Nov 16 19:22:24 user nova-compute[86931]:     </interface>
Nov 16 19:22:24 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:24 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log" append="off"/>
Nov 16 19:22:24 user nova-compute[86931]:     </serial>
Nov 16 19:22:24 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:24 user nova-compute[86931]:     <video>
Nov 16 19:22:24 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:24 user nova-compute[86931]:     </video>
Nov 16 19:22:24 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:24 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:24 user nova-compute[86931]:     </rng>
Nov 16 19:22:24 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:24 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:24 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:24 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:24 user nova-compute[86931]:   </devices>
Nov 16 19:22:24 user nova-compute[86931]: </domain>
Nov 16 19:22:24 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG os_vif [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2633ebda-cba7-5c87-8712-d6201a607e04', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83c9ef40-99, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83c9ef40-99, col_values=(('qos', UUID('3743546b-79c9-4748-9601-112c5bbe3620')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83c9ef40-99, col_values=(('external_ids', {'iface-id': '83c9ef40-990a-44af-a396-98a5de566b42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:4f:09', 'vm-uuid': '7269c7b0-d837-4201-8695-83eeb7c7824f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:24 user nova-compute[86931]: INFO os_vif [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99')
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name hda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No VIF found with MAC fa:16:3e:47:4f:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Using config drive
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Creating config drive at /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config
Nov 16 19:22:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw11in7ze {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Successfully created port: 8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw11in7ze" returned: 0 in 0.069s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:24 user nova-compute[86931]: DEBUG nova.policy [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321517bf41bd4248aef2567a53f901d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ac8cb13963148c985bd5efcce34ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Creating image(s)
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "/opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "/opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "/opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Instance spawned successfully.
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.222s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user sudo[97477]: pam_unix(sudo:session): session closed for user root
Nov 16 19:22:25 user nova-compute[86931]: INFO oslo.privsep.daemon [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Spawned new privsep daemon via rootwrap
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-changed-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing instance network info cache due to event network-changed-83c9ef40-990a-44af-a396-98a5de566b42. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.network.neutron [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing network info cache for port 83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:25 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 19:22:25 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 19:22:25 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 19:22:25 user nova-compute[86931]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 97490
Nov 16 19:22:25 user nova-compute[86931]: INFO nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Took 8.50 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[57998d5b-ad5f-423d-9bb8-75c9c4746c9b]: (2,) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: INFO nova.compute.manager [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Took 9.97 seconds to build instance.
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f680758-33a3-4f1e-9583-4657f142c2f1 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.134s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.342s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk 1073741824" returned: 0 in 0.061s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.407s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ed95d-cad1-4cad-860f-a001fc317e92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: WARNING os_brick.initiator.connectors.nvmeof [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170fd99-775e-4fc1-a7ad-2f9c5846d910]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45a0ae-89da-48d1-a7cc-ad1c819164cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aad0e5-f3fb-4570-9705-4e3383d0fab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.219s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Successfully updated port: 8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:25 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755948b-4d7c-4e32-b123-a94956413fab]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG os_brick.utils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== get_connector_properties: return (2393ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating existing volume attachment record: 18294c50-a25b-46d7-a038-5addf629a913 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquired lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:25 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Successfully created port: bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updated VIF entry in instance network info cache for port 83c9ef40-990a-44af-a396-98a5de566b42. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] No waiting events found dispatching network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:26 user nova-compute[86931]: WARNING nova.compute.manager [req-e209d78b-ae88-4ef8-b246-4e84b8fb6a89 req-318e26ac-3f32-42ef-9feb-9a1687908345 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received unexpected event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 for instance with vm_state building and task_state spawning.
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Cannot resize image /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Ensure instance console log exists: /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating instance_info_cache with network_info: [{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Releasing lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance network_info: |[{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Successfully updated port: bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquired lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-changed-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Refreshing instance network info cache due to event network-changed-8c8f88f6-9aea-4745-ab36-1bae32a5fd44. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Acquiring lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Acquired lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Refreshing network info cache for port 8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updating instance_info_cache with network_info: [{"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Releasing lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Instance network_info: |[{"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Start _get_guest_xml network_info=[{"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946137696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946137696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946137696',id=10,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA0uKjdy9dwU3KNblG4s6llYMYqpUUXzcfc0lw6edCfp+TJz+peFqS4RauWNhc71FwwPKwZRnoyNHtUAJ/Jx9LxvJxPUKgvDp33tkvDxc260X7G6PyxVuB65WNxbqeEfQ==',key_name='tempest-keypair-434943254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ac8cb13963148c985bd5efcce34ab15',ramdisk_id='',reservation_id='r-xtxf04vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1635337682',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1635337682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321517bf41bd4248aef2567a53f901d9',uuid=782a1af8-63f6-4630-b5e2-5819e75c1673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converting VIF {"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lazy-loading 'pci_devices' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:27 user nova-compute[86931]:   <uuid>782a1af8-63f6-4630-b5e2-5819e75c1673</uuid>
Nov 16 19:22:27 user nova-compute[86931]:   <name>instance-0000000a</name>
Nov 16 19:22:27 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:27 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:27 user nova-compute[86931]:   <metadata>
Nov 16 19:22:27 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:27 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1946137696</nova:name>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:27</nova:creationTime>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:27 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:27 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:user uuid="321517bf41bd4248aef2567a53f901d9">tempest-VolumesAssistedSnapshotsTest-1635337682-project-member</nova:user>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:project uuid="9ac8cb13963148c985bd5efcce34ab15">tempest-VolumesAssistedSnapshotsTest-1635337682</nova:project>
Nov 16 19:22:27 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:22:27 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:27 user nova-compute[86931]:         <nova:port uuid="bec091bb-3963-4c71-9dec-aa44ebaf4a7b">
Nov 16 19:22:27 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:22:27 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:27 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:27 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:27 user nova-compute[86931]:   </metadata>
Nov 16 19:22:27 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:27 user nova-compute[86931]:     <system>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="serial">782a1af8-63f6-4630-b5e2-5819e75c1673</entry>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="uuid">782a1af8-63f6-4630-b5e2-5819e75c1673</entry>
Nov 16 19:22:27 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:27 user nova-compute[86931]:     </system>
Nov 16 19:22:27 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:27 user nova-compute[86931]:   <os>
Nov 16 19:22:27 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:27 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:27 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:27 user nova-compute[86931]:   </os>
Nov 16 19:22:27 user nova-compute[86931]:   <features>
Nov 16 19:22:27 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:27 user nova-compute[86931]:     <apic/>
Nov 16 19:22:27 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:27 user nova-compute[86931]:   </features>
Nov 16 19:22:27 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:27 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:27 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:27 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:27 user nova-compute[86931]:   </clock>
Nov 16 19:22:27 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:27 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:27 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:27 user nova-compute[86931]:   </cpu>
Nov 16 19:22:27 user nova-compute[86931]:   <devices>
Nov 16 19:22:27 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:22:27 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:22:27 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk"/>
Nov 16 19:22:27 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:22:27 user nova-compute[86931]:     </disk>
Nov 16 19:22:27 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:27 user nova-compute[86931]:       <mac address="fa:16:3e:18:f6:74"/>
Nov 16 19:22:27 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:27 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:27 user nova-compute[86931]:       <target dev="tapbec091bb-39"/>
Nov 16 19:22:27 user nova-compute[86931]:     </interface>
Nov 16 19:22:27 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:27 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/console.log" append="off"/>
Nov 16 19:22:27 user nova-compute[86931]:     </serial>
Nov 16 19:22:27 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:27 user nova-compute[86931]:     <video>
Nov 16 19:22:27 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:27 user nova-compute[86931]:     </video>
Nov 16 19:22:27 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:27 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:27 user nova-compute[86931]:     </rng>
Nov 16 19:22:27 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:27 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:27 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:27 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:27 user nova-compute[86931]:   </devices>
Nov 16 19:22:27 user nova-compute[86931]: </domain>
Nov 16 19:22:27 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946137696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946137696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946137696',id=10,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA0uKjdy9dwU3KNblG4s6llYMYqpUUXzcfc0lw6edCfp+TJz+peFqS4RauWNhc71FwwPKwZRnoyNHtUAJ/Jx9LxvJxPUKgvDp33tkvDxc260X7G6PyxVuB65WNxbqeEfQ==',key_name='tempest-keypair-434943254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ac8cb13963148c985bd5efcce34ab15',ramdisk_id='',reservation_id='r-xtxf04vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1635337682',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1635337682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321517bf41bd4248aef2567a53f901d9',uuid=782a1af8-63f6-4630-b5e2-5819e75c1673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converting VIF {"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG os_vif [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd94cdab7-9e4b-5165-81d1-c740a3f897ae', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbec091bb-39, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbec091bb-39, col_values=(('qos', UUID('c6fde818-2f4b-4b92-8fa9-c7d5dfd6866a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbec091bb-39, col_values=(('external_ids', {'iface-id': 'bec091bb-3963-4c71-9dec-aa44ebaf4a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:f6:74', 'vm-uuid': '782a1af8-63f6-4630-b5e2-5819e75c1673'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:27 user nova-compute[86931]: INFO os_vif [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39')
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] No VIF found with MAC fa:16:3e:18:f6:74, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updated VIF entry in instance network info cache for port 8c8f88f6-9aea-4745-ab36-1bae32a5fd44. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating instance_info_cache with network_info: [{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Releasing lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-changed-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Refreshing instance network info cache due to event network-changed-bec091bb-3963-4c71-9dec-aa44ebaf4a7b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Acquiring lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Acquired lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Refreshing network info cache for port bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updated VIF entry in instance network info cache for port bec091bb-3963-4c71-9dec-aa44ebaf4a7b. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updating instance_info_cache with network_info: [{"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6fff6bc9-e6d6-4125-9976-c618d61da37d req-52b9ad4b-4366-438d-b608-4649ab079155 service nova] Releasing lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Instance spawned successfully.
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] No waiting events found dispatching network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:29 user nova-compute[86931]: WARNING nova.compute.manager [req-e63613bd-ee70-4ce9-bd2e-173f6cbdf27a req-abba4b54-7e19-4934-b01d-fb70c4e6f4af service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received unexpected event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b for instance with vm_state building and task_state spawning.
Nov 16 19:22:29 user nova-compute[86931]: INFO nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Took 8.59 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:29 user nova-compute[86931]: INFO nova.compute.manager [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Took 9.76 seconds to build instance.
Nov 16 19:22:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70750811-e19d-4b33-a1bc-4bf99b4eea71 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.923s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] No waiting events found dispatching network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:31 user nova-compute[86931]: WARNING nova.compute.manager [req-17e04ab6-9ada-4caa-b46a-e958771459b4 req-578ce784-52d2-406d-a313-6efeaa249ecd service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received unexpected event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b for instance with vm_state building and task_state spawning.
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Instance spawned successfully.
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:31 user nova-compute[86931]: INFO nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:31 user nova-compute[86931]: INFO nova.compute.manager [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Took 8.11 seconds to build instance.
Nov 16 19:22:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c0ed3874-51a2-461d-aec8-b9b6c4fabfc3 tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.385s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:33 user nova-compute[86931]: WARNING nova.compute.manager [req-db2d3511-beea-4513-b054-954d36c705d3 req-0ed2fc7a-a6f0-4e69-9b28-a232b22f24bc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state active and task_state None.
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:22:33 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Creating image(s)
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Ensure instance console log exists: /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start _get_guest_xml network_info=[{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '18294c50-a25b-46d7-a038-5addf629a913', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6311dce-9836-41b2-bfc2-c65262aa3012', 'attached_at': '', 'detached_at': '', 'volume_id': '0b692075-47b9-49ff-931a-c612d8ff61a5', 'serial': '0b692075-47b9-49ff-931a-c612d8ff61a5'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:22:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connector [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Factory for ISCSI on None {{(pid=86931) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:22:33 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:22:33 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:22:33 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc02752-b69b-4786-a748-1a3d285ff6b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:22:33 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e45cc-1162-4e8d-a294-ef33a3047a60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5] added
Nov 16 19:22:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[367911e3-09dd-4415-ab37-45ac9673f5f4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9736d8-b064-4720-bdb1-b29ffa142749]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKCHEJVr {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKCHEJVr" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3b0cd-c719-4120-b9ac-e313741ffc2e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKCHEJVr'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f5ad2e-9e28-492c-9d0d-25140a8d3ce3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8ba24-268e-4032-95d7-aa65af3850bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:22:34 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:22:34 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:22:34 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 19:22:34 user nova-compute[86931]: 
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911ada4-df1a-4d77-9c9c-e4be342a6b5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]
Nov 16 19:22:34 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.
Nov 16 19:22:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b27df-94ce-4d00-a5c3-c155cab9a3fc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbf432-2f6d-47f0-bc8d-6ece3ce98dc2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:22:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:22:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f86a799-79db-423a-a10c-32741fe731e2]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:34 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23261363964636535', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261363964636535', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-574938806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.objects.instance [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lazy-loading 'pci_devices' on Instance uuid e6311dce-9836-41b2-bfc2-c65262aa3012 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:22:35 user nova-compute[86931]:   <uuid>e6311dce-9836-41b2-bfc2-c65262aa3012</uuid>
Nov 16 19:22:35 user nova-compute[86931]:   <name>instance-00000009</name>
Nov 16 19:22:35 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:22:35 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:22:35 user nova-compute[86931]:   <metadata>
Nov 16 19:22:35 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:22:35 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:22:35 user nova-compute[86931]:       <nova:name>tempest-ServerActionsV293TestJSON-server-574938806</nova:name>
Nov 16 19:22:35 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:22:33</nova:creationTime>
Nov 16 19:22:35 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:22:35 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:22:35 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:22:35 user nova-compute[86931]:       <nova:owner>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:user uuid="d8bd27ea76994ab5937a32f4d1ecc806">tempest-ServerActionsV293TestJSON-649419166-project-member</nova:user>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:project uuid="c2255f38550244b2a37369cd6723f44a">tempest-ServerActionsV293TestJSON-649419166</nova:project>
Nov 16 19:22:35 user nova-compute[86931]:       </nova:owner>
Nov 16 19:22:35 user nova-compute[86931]:       <nova:ports>
Nov 16 19:22:35 user nova-compute[86931]:         <nova:port uuid="8c8f88f6-9aea-4745-ab36-1bae32a5fd44">
Nov 16 19:22:35 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:22:35 user nova-compute[86931]:         </nova:port>
Nov 16 19:22:35 user nova-compute[86931]:       </nova:ports>
Nov 16 19:22:35 user nova-compute[86931]:     </nova:instance>
Nov 16 19:22:35 user nova-compute[86931]:   </metadata>
Nov 16 19:22:35 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:22:35 user nova-compute[86931]:     <system>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="serial">e6311dce-9836-41b2-bfc2-c65262aa3012</entry>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="uuid">e6311dce-9836-41b2-bfc2-c65262aa3012</entry>
Nov 16 19:22:35 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:22:35 user nova-compute[86931]:     </system>
Nov 16 19:22:35 user nova-compute[86931]:   </sysinfo>
Nov 16 19:22:35 user nova-compute[86931]:   <os>
Nov 16 19:22:35 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:22:35 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:22:35 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:22:35 user nova-compute[86931]:   </os>
Nov 16 19:22:35 user nova-compute[86931]:   <features>
Nov 16 19:22:35 user nova-compute[86931]:     <acpi/>
Nov 16 19:22:35 user nova-compute[86931]:     <apic/>
Nov 16 19:22:35 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:22:35 user nova-compute[86931]:   </features>
Nov 16 19:22:35 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:22:35 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:22:35 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:22:35 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:22:35 user nova-compute[86931]:   </clock>
Nov 16 19:22:35 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:22:35 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:22:35 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:22:35 user nova-compute[86931]:   </cpu>
Nov 16 19:22:35 user nova-compute[86931]:   <devices>
Nov 16 19:22:35 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:22:35 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:22:35 user nova-compute[86931]:       <source dev="/dev/sdb"/>
Nov 16 19:22:35 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:22:35 user nova-compute[86931]:       <serial>0b692075-47b9-49ff-931a-c612d8ff61a5</serial>
Nov 16 19:22:35 user nova-compute[86931]:     </disk>
Nov 16 19:22:35 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:22:35 user nova-compute[86931]:       <mac address="fa:16:3e:29:ff:97"/>
Nov 16 19:22:35 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:35 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:22:35 user nova-compute[86931]:       <target dev="tap8c8f88f6-9a"/>
Nov 16 19:22:35 user nova-compute[86931]:     </interface>
Nov 16 19:22:35 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:22:35 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012/console.log" append="off"/>
Nov 16 19:22:35 user nova-compute[86931]:     </serial>
Nov 16 19:22:35 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:22:35 user nova-compute[86931]:     <video>
Nov 16 19:22:35 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:22:35 user nova-compute[86931]:     </video>
Nov 16 19:22:35 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:22:35 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:22:35 user nova-compute[86931]:     </rng>
Nov 16 19:22:35 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:22:35 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:22:35 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:22:35 user nova-compute[86931]:     </memballoon>
Nov 16 19:22:35 user nova-compute[86931]:   </devices>
Nov 16 19:22:35 user nova-compute[86931]: </domain>
Nov 16 19:22:35 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-574938806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG os_vif [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a26c133-ccca-5fb9-8ebd-9e8b51b92229', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8f88f6-9a, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8f88f6-9a, col_values=(('qos', UUID('50016281-2b4b-4f4e-80e0-66b0f928d63b')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8f88f6-9a, col_values=(('external_ids', {'iface-id': '8c8f88f6-9aea-4745-ab36-1bae32a5fd44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ff:97', 'vm-uuid': 'e6311dce-9836-41b2-bfc2-c65262aa3012'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:22:35 user nova-compute[86931]: INFO os_vif [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a')
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] No VIF found with MAC fa:16:3e:29:ff:97, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:36 user nova-compute[86931]: WARNING nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state active and task_state None.
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:36 user nova-compute[86931]: WARNING nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state active and task_state None.
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:36 user nova-compute[86931]: WARNING nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state active and task_state None.
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] No waiting events found dispatching network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:36 user nova-compute[86931]: WARNING nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received unexpected event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 for instance with vm_state active and task_state None.
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] No waiting events found dispatching network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:36 user nova-compute[86931]: WARNING nova.compute.manager [req-93f77802-3dfc-47c2-a77f-1696ef775640 req-1e555b5e-a3e0-43e5-91b0-b8473492cefd service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received unexpected event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 for instance with vm_state active and task_state None.
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:37 user nova-compute[86931]: WARNING nova.compute.manager [req-0e5e1450-ad6c-4bdd-aaae-c17d563bd99c req-e83bb955-e2e8-4d68-b0f0-e6d619c7fb78 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state building and task_state spawning.
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:39 user nova-compute[86931]: WARNING nova.compute.manager [req-4187053e-496b-432e-a6ab-f860cffc1422 req-91a4cd1a-f7de-440a-b26c-b8ae3b147437 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state building and task_state spawning.
Nov 16 19:22:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:22:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance spawned successfully.
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:22:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=25.669193267822266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:22:40 user nova-compute[86931]: INFO nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 16 19:22:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:22:40 user nova-compute[86931]: INFO nova.compute.manager [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Took 18.36 seconds to build instance.
Nov 16 19:22:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6a65fc38-267d-4f15-84ec-cd1e76ae7d9d tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.484s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c889eb11-5eb7-4a34-aaf2-82664139b729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b4834f6f-9cdd-450e-bf08-e49d353c3574 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f36e7459-f870-4c1c-b45f-102a09370f04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7269c7b0-d837-4201-8695-83eeb7c7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e6311dce-9836-41b2-bfc2-c65262aa3012 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 782a1af8-63f6-4630-b5e2-5819e75c1673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:22:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:22:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid c889eb11-5eb7-4a34-aaf2-82664139b729 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating instance_info_cache with network_info: [{"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-c889eb11-5eb7-4a34-aaf2-82664139b729" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:22:44 user nova-compute[86931]: INFO nova.compute.claims [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Claim successful on node user
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:22:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:22:45 user nova-compute[86931]: INFO nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Booting with volume b000719d-d10a-4edb-86b4-2bb294fd4a28 at /dev/vda
Nov 16 19:22:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.policy [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c34c4a7db2c84261bf0064cd71cef244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e66d5d6b5dc4d99901e64aa6b9562f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf014d4-3964-45c9-963a-1a56d368f1f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0858e-e5e1-445e-ab48-c75ce04f08ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d16286-b1e7-4bc7-b08e-4520fcf81f0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a35c9aa-b33c-4edf-b5a4-fa34f0e26114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:45 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:22:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db599b0b-d60d-4d2e-9cb2-5d4a50036d17]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating existing volume attachment record: bffd0601-c04e-4a02-ad91-b55ba852944f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:22:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully created port: 38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully created port: 426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully created port: 2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully created port: 1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully created port: c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:22:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: 38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-38c945f9-d08b-4088-90f5-82ed86eb9472. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.network.neutron [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.network.neutron [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.network.neutron [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3f0d4649-9ff0-4a21-afb2-76d6419e0705 req-f7bb52fb-5d60-4471-b22d-e84eca3c7291 service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: 66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:50 user nova-compute[86931]: INFO nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Booting with volume 3c6f616b-7b16-4efb-9fc4-04d1983d8b46 at /dev/vdb
Nov 16 19:22:50 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[176363d4-f6a7-4b6d-b4dd-48ea74867bc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c100c8-5331-438b-9544-c39234245477]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe84ecf0-f894-4137-836e-ba8a427a6bba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a811ce4-295d-4a08-a275-8eb845fecbd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-e4b8cb5a-7eb3-43aa-8945-fc14827af191. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:51 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a0d5ae-6ea0-4022-8e07-05f824645723]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating existing volume attachment record: e479709d-1d0a-45de-a201-eef74d48e07f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: 426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-66133fec-c906-4f0a-8c2f-41b27c30e4fa. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:51 user nova-compute[86931]: WARNING nova.compute.manager [req-be26badd-6d76-47ee-aec2-2436c3453355 req-0abfdec9-af89-42d7-bcc9-7b68a8bef59e service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 for instance with vm_state active and task_state None.
Nov 16 19:22:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ff10aeb-ea0f-4401-89d2-a8d4fd804b5c req-0a3b7bf9-40ef-426b-89d5-abdf56b888d7 service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: 2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: 1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-426031cc-fe4e-471f-ba51-af89f3b4e011. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Successfully updated port: c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:22:53 user nova-compute[86931]: WARNING nova.compute.manager [req-6a9d048f-438c-4e91-980d-7d4a209a94ce req-54a4c8e1-d49d-47ee-aa44-e9c843e89010 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 for instance with vm_state active and task_state None.
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-1121d492-f35c-4c80-84c0-ca6fd568bcc9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b18604ab-1f04-4386-a96a-9fed9d9edfa1 req-ffd2d54a-ca84-4dca-80e4-8201c3535fad service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:22:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:22:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:22:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-c8024acd-1d97-429e-b36b-4ab162b2da31. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:22:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:22:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance network_info: |[{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updated VIF entry in instance network info cache for port c8024acd-1d97-429e-b36b-4ab162b2da31. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f25c9f1f-cdde-44e4-b497-b8e909499daa req-6155e42d-bb5c-44b1-87fe-93d0df92d04e service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:22:56 user nova-compute[86931]: INFO nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Booting with volume 76195417-9735-4859-aee0-7cb006450ed3 at /dev/vdc
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb88a6f-8e90-430d-a75b-79b4b3f6ccb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1ec5a-e2e3-40ed-9f18-0c34822f7eab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0ab51-b437-4623-8714-e44e625f9f09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca31578-c49f-4a6a-b060-249dbf67288d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:22:56 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:22:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2060a8-2c8c-4f66-a584-3faaafd9de8d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:22:56 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating existing volume attachment record: 89a6e503-dacf-403e-ae64-6f02bea75048 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:23:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:23:01 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Creating image(s)
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Ensure instance console log exists: /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Start _get_guest_xml network_info=[{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'bffd0601-c04e-4a02-ad91-b55ba852944f', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrMwQmpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b35d0170-ff37-4a3d-b748-47778fd4accf', 'attached_at': '', 'detached_at': '', 'volume_id': 'b000719d-d10a-4edb-86b4-2bb294fd4a28', 'serial': 'b000719d-d10a-4edb-86b4-2bb294fd4a28'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'e479709d-1d0a-45de-a201-eef74d48e07f', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCgJnDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b35d0170-ff37-4a3d-b748-47778fd4accf', 'attached_at': '', 'detached_at': '', 'volume_id': '3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 'serial': '3c6f616b-7b16-4efb-9fc4-04d1983d8b46'}, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '89a6e503-dacf-403e-ae64-6f02bea75048', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUfybjhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b35d0170-ff37-4a3d-b748-47778fd4accf', 'attached_at': '', 'detached_at': '', 'volume_id': '76195417-9735-4859-aee0-7cb006450ed3', 'serial': '76195417-9735-4859-aee0-7cb006450ed3'}, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:23:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:23:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrMwQmpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:01 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6532db-adc0-426a-bd21-c4c85bb2cb88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:01 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa6a382-a428-452c-9042-f29d5107ac1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28] added
Nov 16 19:23:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c5f07-73e8-4d1a-891c-dea107aeda45]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49acbd-2774-4b10-8b94-14d6bbea866c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrMwQmpA {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrMwQmpA" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b966043-c653-4df8-9f71-67cfba04e3d8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrMwQmpA'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e136be42-df42-43dd-879d-96f191ca19ed]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2448de67-1b6a-42f0-898f-23ab4f463cd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8972c5-291f-4b9f-a202-08e1b5b974e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260]
Nov 16 19:23:02 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013f646-a579-4757-bd1a-81c8ac4b86a9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4ec78-bc12-477f-9b9d-663a6cec3111]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc93d2b-b435-458a-878a-6febf02a7e05]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:23:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrMwQmpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26165653466633130', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165653466633130', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCgJnDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:03 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:03 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:03 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd266c-ecf5-4fb1-bc2d-a4568232eb62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:03 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0700a3-ef0c-4ea8-8a3c-05e8d16b7ec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46] added
Nov 16 19:23:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5572fc7a-0143-42c8-a68d-3b1d957920f9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a907e0-205e-4f2b-945b-3a445fecffd7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCgJnDyj {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCgJnDyj" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf83f8c-508f-4c2d-808f-7e72d4cffa08]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCgJnDyj'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ff372-81ef-4a87-b1dc-a2d9ad697672]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa81ef2d-6dc5-4925-99e4-77100cb6bfcd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:03 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:03 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --login" returned: 0 in 1.066s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f50b7f-d00b-486e-aad3-ff0c6beb1e50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260]
Nov 16 19:23:04 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7fcf9-4ea9-42e7-8dca-5167b8364667]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[33afe85e-1751-48bf-b02d-ca851f22384f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.280s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7666be33-669a-46b4-9da4-718e5d24d556]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:23:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCgJnDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.317s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== connect_volume: return (2318ms) {'type': 'block', 'scsi_wwn': '23331303431316433', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331303431316433', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUfybjhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:05 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:05 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:05 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb57bf9-4363-4acd-9c8b-ad0dd07b6719]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:05 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5496e-2d73-4e91-b41c-95b3591d7375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3] added
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[754ff272-b98c-4717-9666-08ea9e1eaac8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c481a-54d4-41b7-a8fd-e5dbf2ae55b8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUfybjhC {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OUfybjhC" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da488a7-cc93-4845-9e0e-1719cedfc488]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OUfybjhC'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf52e86-bccc-4eec-9c80-22766a1f5d11]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37e23c-862e-49f8-8050-1a25f46c5cc2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2cb1b9-63c2-4fd2-bcc0-24abf4724fbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260]
Nov 16 19:23:05 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d902f261-77d8-4993-ab25-aee8f513c7f7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d122f-51f6-4057-bf2f-da93d5101250]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd81f14d-e07e-4e46-8f55-10723d09c7a8]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUfybjhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:23:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23235343465653865', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235343465653865', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lazy-loading 'pci_devices' on Instance uuid b35d0170-ff37-4a3d-b748-47778fd4accf {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:23:06 user nova-compute[86931]:   <uuid>b35d0170-ff37-4a3d-b748-47778fd4accf</uuid>
Nov 16 19:23:06 user nova-compute[86931]:   <name>instance-0000000b</name>
Nov 16 19:23:06 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:23:06 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:23:06 user nova-compute[86931]:   <metadata>
Nov 16 19:23:06 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:23:06 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:name>tempest-device-tagging-server-891382957</nova:name>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:23:01</nova:creationTime>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:23:06 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:23:06 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:owner>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:user uuid="c34c4a7db2c84261bf0064cd71cef244">tempest-TaggedBootDevicesTest_v242-2112492756-project-member</nova:user>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:project uuid="7e66d5d6b5dc4d99901e64aa6b9562f1">tempest-TaggedBootDevicesTest_v242-2112492756</nova:project>
Nov 16 19:23:06 user nova-compute[86931]:       </nova:owner>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:23:06 user nova-compute[86931]:       <nova:ports>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="38c945f9-d08b-4088-90f5-82ed86eb9472">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="e4b8cb5a-7eb3-43aa-8945-fc14827af191">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="66133fec-c906-4f0a-8c2f-41b27c30e4fa">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="426031cc-fe4e-471f-ba51-af89f3b4e011">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="2f8918dd-1a9f-45f8-9c74-1b33ea5901c3">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="1121d492-f35c-4c80-84c0-ca6fd568bcc9">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:         <nova:port uuid="c8024acd-1d97-429e-b36b-4ab162b2da31">
Nov 16 19:23:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 19:23:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:23:06 user nova-compute[86931]:       </nova:ports>
Nov 16 19:23:06 user nova-compute[86931]:     </nova:instance>
Nov 16 19:23:06 user nova-compute[86931]:   </metadata>
Nov 16 19:23:06 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:23:06 user nova-compute[86931]:     <system>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="serial">b35d0170-ff37-4a3d-b748-47778fd4accf</entry>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="uuid">b35d0170-ff37-4a3d-b748-47778fd4accf</entry>
Nov 16 19:23:06 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:23:06 user nova-compute[86931]:     </system>
Nov 16 19:23:06 user nova-compute[86931]:   </sysinfo>
Nov 16 19:23:06 user nova-compute[86931]:   <os>
Nov 16 19:23:06 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:23:06 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:23:06 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:23:06 user nova-compute[86931]:   </os>
Nov 16 19:23:06 user nova-compute[86931]:   <features>
Nov 16 19:23:06 user nova-compute[86931]:     <acpi/>
Nov 16 19:23:06 user nova-compute[86931]:     <apic/>
Nov 16 19:23:06 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:23:06 user nova-compute[86931]:   </features>
Nov 16 19:23:06 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:23:06 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:23:06 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:23:06 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:23:06 user nova-compute[86931]:   </clock>
Nov 16 19:23:06 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:23:06 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:23:06 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:23:06 user nova-compute[86931]:   </cpu>
Nov 16 19:23:06 user nova-compute[86931]:   <devices>
Nov 16 19:23:06 user nova-compute[86931]:     <disk type="file" device="cdrom">
Nov 16 19:23:06 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 19:23:06 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/disk.config"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="hda" bus="ide"/>
Nov 16 19:23:06 user nova-compute[86931]:     </disk>
Nov 16 19:23:06 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:23:06 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:23:06 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <serial>b000719d-d10a-4edb-86b4-2bb294fd4a28</serial>
Nov 16 19:23:06 user nova-compute[86931]:     </disk>
Nov 16 19:23:06 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:23:06 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:23:06 user nova-compute[86931]:       <source dev="/dev/sdd"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <serial>3c6f616b-7b16-4efb-9fc4-04d1983d8b46</serial>
Nov 16 19:23:06 user nova-compute[86931]:     </disk>
Nov 16 19:23:06 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:23:06 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:23:06 user nova-compute[86931]:       <source dev="/dev/sde"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="vdc" bus="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <serial>76195417-9735-4859-aee0-7cb006450ed3</serial>
Nov 16 19:23:06 user nova-compute[86931]:     </disk>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:0d:b8:8a"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tap38c945f9-d0"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:35:83:15"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tape4b8cb5a-7e"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:bc:c0:55"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tap66133fec-c9"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:68:e9:a2"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tap426031cc-fe"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:41:a7:07"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tap2f8918dd-1a"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:eb:e3:a6"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tap1121d492-f3"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:23:06 user nova-compute[86931]:       <mac address="fa:16:3e:b9:3f:8f"/>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:23:06 user nova-compute[86931]:       <target dev="tapc8024acd-1d"/>
Nov 16 19:23:06 user nova-compute[86931]:     </interface>
Nov 16 19:23:06 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:23:06 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/console.log" append="off"/>
Nov 16 19:23:06 user nova-compute[86931]:     </serial>
Nov 16 19:23:06 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:23:06 user nova-compute[86931]:     <video>
Nov 16 19:23:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:23:06 user nova-compute[86931]:     </video>
Nov 16 19:23:06 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:23:06 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:23:06 user nova-compute[86931]:     </rng>
Nov 16 19:23:06 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:23:06 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:23:06 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:23:06 user nova-compute[86931]:     </memballoon>
Nov 16 19:23:06 user nova-compute[86931]:   </devices>
Nov 16 19:23:06 user nova-compute[86931]: </domain>
Nov 16 19:23:06 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efda5591-9033-5c0a-9548-f81e546f54af', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38c945f9-d0, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38c945f9-d0, col_values=(('qos', UUID('b4cb144e-8cb0-44ea-9b29-cdeef833ca3d')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38c945f9-d0, col_values=(('external_ids', {'iface-id': '38c945f9-d08b-4088-90f5-82ed86eb9472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:b8:8a', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2fecd6a-ed4c-55e6-ae52-a55a08e8c691', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4b8cb5a-7e, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4b8cb5a-7e, col_values=(('qos', UUID('66cc7863-e5d8-4a53-a441-4d0eafaab241')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4b8cb5a-7e, col_values=(('external_ids', {'iface-id': 'e4b8cb5a-7eb3-43aa-8945-fc14827af191', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:83:15', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b968ca8-6a85-5de1-97ef-ba969a1ad8e5', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66133fec-c9, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66133fec-c9, col_values=(('qos', UUID('a8df27ee-0e73-49ef-adaf-5e7b1790ee02')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66133fec-c9, col_values=(('external_ids', {'iface-id': '66133fec-c906-4f0a-8c2f-41b27c30e4fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:c0:55', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2587286b-0b5e-5030-b7b3-a35e7197ee47', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap426031cc-fe, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap426031cc-fe, col_values=(('qos', UUID('a0fce36e-2d05-4eb4-b5ab-6f0fa2e5125d')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap426031cc-fe, col_values=(('external_ids', {'iface-id': '426031cc-fe4e-471f-ba51-af89f3b4e011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:e9:a2', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5906a05b-5911-51f2-8e35-f551a0d2b669', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f8918dd-1a, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f8918dd-1a, col_values=(('qos', UUID('5ef49a73-a72d-4751-b418-9b4243f233f1')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f8918dd-1a, col_values=(('external_ids', {'iface-id': '2f8918dd-1a9f-45f8-9c74-1b33ea5901c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:a7:07', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42908ae7-4c27-51d0-a2de-da2dfe93e0c3', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1121d492-f3, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1121d492-f3, col_values=(('qos', UUID('a57d2dd5-fa69-4acf-a7f1-e507c2ff4c75')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1121d492-f3, col_values=(('external_ids', {'iface-id': '1121d492-f35c-4c80-84c0-ca6fd568bcc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:e3:a6', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82a07392-b997-5641-9c17-98a561f800a0', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8024acd-1d, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8024acd-1d, col_values=(('qos', UUID('659674e5-caf4-4a22-84cf-2cf56fb5034c')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8024acd-1d, col_values=(('external_ids', {'iface-id': 'c8024acd-1d97-429e-b36b-4ab162b2da31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:3f:8f', 'vm-uuid': 'b35d0170-ff37-4a3d-b748-47778fd4accf'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:07 user nova-compute[86931]: INFO os_vif [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d')
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] No BDM found with device name hda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] No VIF found with MAC fa:16:3e:0d:b8:8a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:23:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] No VIF found with MAC fa:16:3e:41:a7:07, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:23:07 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Using config drive
Nov 16 19:23:07 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Creating config drive at /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/disk.config
Nov 16 19:23:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1irqjbxe {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1irqjbxe" returned: 0 in 0.059s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:10 user nova-compute[86931]: WARNING nova.compute.manager [req-25fe4f92-240b-4a73-8261-684631386937 req-a1c48586-16e0-4484-8887-f017108638bf service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 for instance with vm_state building and task_state spawning.
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:10 user nova-compute[86931]: WARNING nova.compute.manager [req-b6adee1c-c3b3-48dc-8a26-0b673a7dc9a5 req-4d5aa64d-964d-4213-9bb5-6e176065c9f4 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 for instance with vm_state building and task_state spawning.
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-f623bf41-36eb-481e-b8f7-fdbb94bfd91e req-e52ed351-83e1-4c7b-b285-b49774e6f84f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:12 user nova-compute[86931]: WARNING nova.compute.manager [req-395922db-df19-4e19-9a5e-0307b1fc4b4d req-962f042d-e0f1-44e7-8c9d-c74b8b481831 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 for instance with vm_state building and task_state spawning.
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:23:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance spawned successfully.
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:23:14 user nova-compute[86931]: INFO nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Took 12.20 seconds to spawn the instance on the hypervisor.
Nov 16 19:23:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:23:14 user nova-compute[86931]: INFO nova.compute.manager [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Took 29.28 seconds to build instance.
Nov 16 19:23:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d33cbecc-de18-4cc9-a372-ef632e73849d tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.389s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:23:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:23:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-changed-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Refreshing instance network info cache due to event network-changed-81b4eea3-5c4e-4a28-8c21-51adc18be286. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Refreshing network info cache for port 81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lazy-loading 'flavor' on Instance uuid c889eb11-5eb7-4a34-aaf2-82664139b729 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:34 user nova-compute[86931]: INFO nova.compute.manager [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Attaching volume 3ffdb7f3-657b-481d-9473-7eae4dcb4922 to /dev/vdb
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updated VIF entry in instance network info cache for port 81b4eea3-5c4e-4a28-8c21-51adc18be286. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG os_brick.utils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ada50f94-f535-4c1d-9ccd-9bb3180d26c9 req-e178e57c-8c3f-4fd9-8328-c13d285e5fef service nova] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e6612-d4ad-4457-8dc8-ea964f263684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692a4f5-dbba-4f71-bfd4-0238dfec9f83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e7da0-af1c-47c9-a923-d0eeea3b0d03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2cac5-b752-4492-98ed-f8c3517ff4a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:35 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba7613-3acd-4738-ac1c-e18aaa8b0905]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG os_brick.utils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating existing volume attachment record: afa33cc9-0945-4986-b4a0-f9e22908a975 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:23:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing instance network info cache due to event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated VIF entry in instance network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-16659f58-fb28-4212-ade5-49e59b6dc71d req-c8bbfb8a-fa24-413a-93e8-681277225af0 service nova] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:23:37 user nova-compute[86931]: INFO nova.compute.manager [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] instance snapshotting
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Beginning live snapshot process
Nov 16 19:23:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.161s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:37 user nova-compute[86931]: INFO nova.compute.manager [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Attaching volume 98febdf2-a358-42d4-803f-c936b5dd1100 to /dev/vdb
Nov 16 19:23:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.utils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d119e83d-44ab-40a2-b3f8-4725a3dd485c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c208c5-052d-4693-8640-1a3db13f3cef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8a6b5-eb33-46c6-808e-97eca5f55f6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe5940-6896-4f74-89c4-56620615af78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:38 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[98696d64-f274-408c-82b3-ec1861e5e416]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG os_brick.utils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating existing volume attachment record: 25f16e59-09b0-4550-aff6-7a21806f8feb {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7.delta 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7.delta 1073741824" returned: 0 in 0.046s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 19:23:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Checking UEFI support for host arch (x86_64) {{(pid=86931) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 19:23:38 user nova-compute[86931]: INFO nova.virt.libvirt.host [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] UEFI support detected
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:23:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:23:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=6884MB free_disk=25.551036834716797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:23:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfWTvlhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:40 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:40 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:40 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d66e9-620c-421d-a951-0268930d3c08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:40 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[84324419-ca6e-412c-9dd9-ca23b1c835f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922] added
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7.delta /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879c364-0a5b-4453-9687-8398dfa992fa]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578b4fe-30b8-4557-b080-635003406513]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfWTvlhA {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c889eb11-5eb7-4a34-aaf2-82664139b729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b4834f6f-9cdd-450e-bf08-e49d353c3574 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f36e7459-f870-4c1c-b45f-102a09370f04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7269c7b0-d837-4201-8695-83eeb7c7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e6311dce-9836-41b2-bfc2-c65262aa3012 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 782a1af8-63f6-4630-b5e2-5819e75c1673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b35d0170-ff37-4a3d-b748-47778fd4accf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfWTvlhA" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40bbc72-3dae-46d3-96bb-f69dd342c20a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QfWTvlhA'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfac37bc-6aa8-43db-a551-f0cfe58b060d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c5530-4ffb-492c-b78e-e6c834080be8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a6fd25-bc2c-4884-b314-df99996965c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260]
Nov 16 19:23:40 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a0621e-bb53-4e46-a3e7-c593b3bebe65]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2a980-9201-43dc-93c8-40f68ece0555]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)
Nov 16 19:23:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db714c9-15e9-4c9d-bf0c-0ca48fbd5239]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfWTvlhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7.delta /opt/stack/data/nova/instances/snapshots/tmp9n1_me8q/544941e83a354e5bba193c3f21b6e6a7" returned: 0 in 0.478s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Snapshot extracted, beginning image upload
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:23:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '26365616136313462', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365616136313462', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lazy-loading 'flavor' on Instance uuid c889eb11-5eb7-4a34-aaf2-82664139b729 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:23:41 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:23:41 user nova-compute[86931]:   <source dev="/dev/sdf"/>
Nov 16 19:23:41 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:23:41 user nova-compute[86931]:   <serial>3ffdb7f3-657b-481d-9473-7eae4dcb4922</serial>
Nov 16 19:23:41 user nova-compute[86931]: </disk>
Nov 16 19:23:41 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] No VIF found with MAC fa:16:3e:ff:f3:3e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-34a384de-29a7-470b-82ed-9d5af170ff2f tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.476s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:42 user nova-compute[86931]: INFO nova.compute.manager [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Terminating instance
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-unplugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] No waiting events found dispatching network-vif-unplugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-020bd716-7813-47a5-be58-3eea1bf80e18 req-deb3700c-c5fb-442e-ad4a-de33a9384127 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-unplugged-0bd1df0e-a81e-41da-ba09-307bcf547438 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Instance destroyed successfully.
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lazy-loading 'resources' on Instance uuid c889eb11-5eb7-4a34-aaf2-82664139b729 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2114741729',display_name='tempest-DeleteServersTestJSON-server-2114741729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2114741729',id=1,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fc58e1aecf84b5881a9b6188eaed5e3',ramdisk_id='',reservation_id='r-i8gzhdc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1819981616',owner_user_name='tempest-DeleteServersTestJSON-1819981616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:00Z,user_data=None,user_id='00bb9410e0b740d2a60f9918e956c57b',uuid=c889eb11-5eb7-4a34-aaf2-82664139b729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converting VIF {"id": "0bd1df0e-a81e-41da-ba09-307bcf547438", "address": "fa:16:3e:ff:f3:3e", "network": {"id": "552ed757-f776-49ae-96a7-b33dc2008361", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1556031727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fc58e1aecf84b5881a9b6188eaed5e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bd1df0e-a8", "ovs_interfaceid": "0bd1df0e-a81e-41da-ba09-307bcf547438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_vif [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bd1df0e-a8, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a369c8c9-07fc-4a86-84e4-20b6afb3ddb8) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:43 user nova-compute[86931]: INFO os_vif [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:f3:3e,bridge_name='br-int',has_traffic_filtering=True,id=0bd1df0e-a81e-41da-ba09-307bcf547438,network=Network(552ed757-f776-49ae-96a7-b33dc2008361),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bd1df0e-a8')
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfWTvlhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d726e-3a5d-44c1-a1ee-0f1f9d96e59a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:23:43 user nova-compute[86931]: No targets found.
Nov 16 19:23:43 user nova-compute[86931]: iSNS:
Nov 16 19:23:43 user nova-compute[86931]: No targets found.
Nov 16 19:23:43 user nova-compute[86931]: STATIC:
Nov 16 19:23:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:23:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:23:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:23:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:23:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:23:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:23:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922
Nov 16 19:23:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:23:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:23:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:23:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:23:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:23:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:23:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:23:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:23:43 user nova-compute[86931]: FIRMWARE:
Nov 16 19:23:43 user nova-compute[86931]: No targets found.
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:23:43 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:23:43 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a88d1d-18bc-48f8-83c1-3e1008e76941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72fd97-d002-439a-80b5-a64b4b45f33e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c5c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f014ae-7f5d-4a59-bd73-0a14d69d3fb4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9a363b-4592-40e1-99d0-7c87a4028ffa]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6aa30b-300b-42ff-9047-72839c085ddf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c00c7d-fb65-44f4-b11f-1e6b85206883]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacc3459-6a81-486c-8602-f5d18e20bc76]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Snapshot image upload complete
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.compute.manager [None req-dca8ade6-a70c-4619-8726-4474f5310ba8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Took 6.13 seconds to snapshot the instance on the hypervisor.
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb662ee3-769e-4535-b009-bb1726ccf627]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260]
Nov 16 19:23:43 user nova-compute[86931]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ffdb7f3-657b-481d-9473-7eae4dcb4922 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d36c36-2a4a-4e0e-a7ed-cd8921594001]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] <== disconnect_volume: return (327ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Deleting instance files /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729_del
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Deletion of /opt/stack/data/nova/instances/c889eb11-5eb7-4a34-aaf2-82664139b729_del complete
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.114s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:43 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0246c-85c5-4c9f-806f-4ca760b0c603]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:43 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa5452-66c3-42e7-84d2-365198ae1375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100] added
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: INFO nova.compute.manager [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb517d-1c66-4ebb-af36-32dc0184dbac]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac825a3c-9c7b-49f2-8dba-8b2b713ee9db]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYaHRvrq {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYaHRvrq" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b22076-2bfb-4900-b14a-f91945300b9c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYaHRvrq'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e534dc8-7a19-483e-a23a-2b9643771b0e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28acb6b-89f7-482f-bc75-3a0c21aebebc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2d441-cc06-467e-aacd-1a3852cadeb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]
Nov 16 19:23:43 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1285cb-85c2-414c-a41b-9c802387d1b0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bffdc-bcef-4add-85d4-eb63d4bce8cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:23:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:23:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82345d47-ec3d-4f97-b66d-39479c85e226]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:44 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Took 0.48 seconds to deallocate network for instance.
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-52f5a092-ac3e-46d6-9398-5dcd7b2dbdb7 req-eae1ded9-8103-499e-a3a7-4869bbfcbae3 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-deleted-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:44 user nova-compute[86931]: INFO nova.compute.manager [req-52f5a092-ac3e-46d6-9398-5dcd7b2dbdb7 req-eae1ded9-8103-499e-a3a7-4869bbfcbae3 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Neutron deleted interface 0bd1df0e-a81e-41da-ba09-307bcf547438; detaching it from the instance and deleting it from the info cache
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.network.neutron [req-52f5a092-ac3e-46d6-9398-5dcd7b2dbdb7 req-eae1ded9-8103-499e-a3a7-4869bbfcbae3 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-52f5a092-ac3e-46d6-9398-5dcd7b2dbdb7 req-eae1ded9-8103-499e-a3a7-4869bbfcbae3 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Detach interface failed, port_id=0bd1df0e-a81e-41da-ba09-307bcf547438, reason: Instance c889eb11-5eb7-4a34-aaf2-82664139b729 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] Acquiring lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] No waiting events found dispatching network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:44 user nova-compute[86931]: WARNING nova.compute.manager [req-69acfa75-87ce-4850-80c7-18a1aa6d04d2 req-a8b39faf-3e9c-4737-8e69-1530c6fa4597 service nova] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Received unexpected event network-vif-plugged-0bd1df0e-a81e-41da-ba09-307bcf547438 for instance with vm_state active and task_state deleting.
Nov 16 19:23:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23737623730636538', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737623730636538', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:23:45 user nova-compute[86931]: INFO nova.compute.manager [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] [instance: c889eb11-5eb7-4a34-aaf2-82664139b729] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:23:45 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:23:45 user nova-compute[86931]:   <source dev="/dev/sdf"/>
Nov 16 19:23:45 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:23:45 user nova-compute[86931]:   <serial>98febdf2-a358-42d4-803f-c936b5dd1100</serial>
Nov 16 19:23:45 user nova-compute[86931]: </disk>
Nov 16 19:23:45 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:45 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Deleted allocations for instance c889eb11-5eb7-4a34-aaf2-82664139b729
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No VIF found with MAC fa:16:3e:00:91:45, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0ab65de0-bfd8-43b4-a3c3-128ce070f3df tempest-DeleteServersTestJSON-1819981616 tempest-DeleteServersTestJSON-1819981616-project-member] Lock "c889eb11-5eb7-4a34-aaf2-82664139b729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a0c535b-0bb2-4c84-9f99-c2cb43796abc tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.700s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=86931) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG nova.objects.instance [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:47 user nova-compute[86931]: WARNING nova.compute.manager [req-056915de-6d99-4c79-bdd0-38039a2c9adb req-b07ff674-63d1-4bee-b85a-3b9a498c5fdc service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state active and task_state powering-off.
Nov 16 19:23:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance destroyed successfully.
Nov 16 19:23:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:23:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31821ed1-0b7b-4411-b60e-4cd011d29d2f tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.827s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:23:49 user nova-compute[86931]: WARNING nova.compute.manager [req-e1b86b28-2b52-4031-bfbc-7e32e32e54eb req-7d16c026-0888-45a1-b2bd-5520106e4d74 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state None.
Nov 16 19:23:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-changed-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Refreshing instance network info cache due to event network-changed-a81af5e5-4748-4c34-887a-5988dfde05ab. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:23:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] Acquiring lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:23:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] Acquired lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:23:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Refreshing network info cache for port a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:23:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updated VIF entry in instance network info cache for port a81af5e5-4748-4c34-887a-5988dfde05ab. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:23:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating instance_info_cache with network_info: [{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be34e044-f5aa-4f90-a309-b7262e910937 req-09b50e3f-524b-4097-95b7-b0bc3efa22e3 service nova] Releasing lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:23:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'flavor' on Instance uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:54 user nova-compute[86931]: INFO nova.compute.manager [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Attaching volume cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 to /dev/vdb
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c20c4-6320-45b5-ad45-1b550c40d960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef817c23-70eb-4126-8f2f-dcab079708eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c7e735-5b6a-4755-84e4-91f41f05e5ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce79572-a453-4efb-aa53-e7a0711bf4df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:23:54 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:23:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe485a32-625a-435b-8022-e7c09131f6b0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:23:54 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating existing volume attachment record: e0eb9487-a901-4a3b-8e3b-e48730bf5471 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:23:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-changed-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Refreshing instance network info cache due to event network-changed-46896ae9-01ff-4227-a74f-5d956d539d46. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] Acquiring lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] Acquired lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Refreshing network info cache for port 46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lazy-loading 'flavor' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGAIULvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:23:59 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb1403b-0d03-4ae4-bb3d-ca6e13e72e99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:23:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c33cd-081f-428a-8a47-216f7339f7e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4] added
Nov 16 19:23:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c77f55-8053-49e3-9e5c-c45236238ffc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4f21f-3c7d-4d15-ad31-597886c85533]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGAIULvH {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGAIULvH" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78273f-6d81-4571-97b6-6060fdeff6cc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGAIULvH'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ecb1d5-6b8f-470b-8689-1e0ff085f751]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:23:59 user nova-compute[86931]: INFO nova.compute.manager [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attaching volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c to /dev/vdb
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4508696-6791-4cf0-a151-8b346d13d721]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:23:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updated VIF entry in instance network info cache for port 46896ae9-01ff-4227-a74f-5d956d539d46. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updating instance_info_cache with network_info: [{"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.utils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c824df4-03a6-411c-86db-d2a8cdcb7db9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1a5a98e-4e82-46bd-9147-7f51d7bf0ec6 req-e3858149-23ac-44df-91dd-c80ff23ec7bf service nova] Releasing lock "refresh_cache-b4834f6f-9cdd-450e-bf08-e49d353c3574" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1418c556-3a51-48e9-9978-21588adb4f43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1794fba-b393-4d1e-8bd4-4b9da880e7a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260]
Nov 16 19:23:59 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260] successful.
Nov 16 19:23:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a13f78-d026-4847-b8ab-adb25d51476b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb70d53-a1e7-4bd2-874b-1009bcfdb7a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:23:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a789d0cd-0696-4e18-903a-979464219916]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:00 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3591b56-bf53-4a56-a772-b113e9436720]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.utils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updating existing volume attachment record: 09da7fa2-2a27-42b6-892e-4a27b559d01b {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec557243-4284-4ca8-abc6-976e05265d5f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac7255-f9ed-4194-b8d6-99073b66821f]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGAIULvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26530303963343166', 'path': '/dev/sdg'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303963343166', 'path': '/dev/sdg'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'flavor' on Instance uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:24:01 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:01 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:01 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:01 user nova-compute[86931]:   <serial>cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4</serial>
Nov 16 19:24:01 user nova-compute[86931]: </disk>
Nov 16 19:24:01 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No VIF found with MAC fa:16:3e:05:bf:bd, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-642bb426-cbfc-463b-bd6b-2e6ecb82163b tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.122s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:02 user nova-compute[86931]: INFO nova.compute.manager [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Detaching volume cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4
Nov 16 19:24:02 user nova-compute[86931]: INFO nova.virt.block_device [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Attempting to driver detach volume cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 from mountpoint /dev/vdb
Nov 16 19:24:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Attempting to detach device vdb from instance e16458c7-133e-4424-bc89-018f28f6a546 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:02 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:02 user nova-compute[86931]:   <serial>cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4</serial>
Nov 16 19:24:02 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:02 user nova-compute[86931]: </disk>
Nov 16 19:24:02 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully detached device vdb from instance e16458c7-133e-4424-bc89-018f28f6a546 from the persistent domain config.
Nov 16 19:24:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e16458c7-133e-4424-bc89-018f28f6a546 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:02 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:02 user nova-compute[86931]:   <serial>cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4</serial>
Nov 16 19:24:02 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:02 user nova-compute[86931]: </disk>
Nov 16 19:24:02 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:05 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:05 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:05 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbae7a1-5662-4963-8961-c25dce96f84c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:05 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad95f651-d390-4fda-9abb-734bd76d6384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c] added
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f618b968-1ff5-4db2-9681-d22ca2a78ac3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[907034a1-8d97-45bc-a75c-0fc440fad7ec]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrcenduY {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrcenduY" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf91194-2c86-484e-8e53-a2d87f953007]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrcenduY'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b161fc42-33ee-489f-953a-9bf26d8f2bbd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2df3d-7dba-49fa-a6cf-3f92ae889c4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286da5d-55ba-4c28-b814-decc903d2258]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]
Nov 16 19:24:05 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81c5d6-c40e-4b09-a4bc-5ed778f31f4e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab193b-98ed-4edb-ad0a-b2da5466042a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:05 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa0504-5734-439b-bdbe-4dc0ccf979ce]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-changed-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Refreshing instance network info cache due to event network-changed-4b6e21ac-041b-49a7-a569-059d0e03d511. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] Acquiring lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] Acquired lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Refreshing network info cache for port 4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updated VIF entry in instance network info cache for port 4b6e21ac-041b-49a7-a569-059d0e03d511. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updating instance_info_cache with network_info: [{"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f61f0f56-3470-4e90-bd23-44655e7a8c4a req-3dd137fb-8128-4931-8521-e98dc3658832 service nova] Releasing lock "refresh_cache-f36e7459-f870-4c1c-b45f-102a09370f04" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23234323136346134', 'path': '/dev/sdh'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234323136346134', 'path': '/dev/sdh'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lazy-loading 'flavor' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:24:06 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:06 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:24:06 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:06 user nova-compute[86931]:   <serial>a1c652c0-45d9-47bd-8108-cf96fd0b9a8c</serial>
Nov 16 19:24:06 user nova-compute[86931]: </disk>
Nov 16 19:24:06 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] No VIF found with MAC fa:16:3e:02:1c:f3, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a52b0bb0-b33d-4bc6-90a7-bd0ee09b674b tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.159s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lazy-loading 'flavor' on Instance uuid f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:07 user nova-compute[86931]: INFO nova.compute.manager [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Attaching volume 5a667758-c1bd-4f62-99ed-4c465a1af280 to /dev/sdc
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.utils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1036c05e-d4fb-4669-a3ba-202d1c1ff5a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6c134-2d55-419e-9705-643fd4066220]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f16159d-642a-433e-807d-b7c34fdddcaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b069bc9-b83a-49fc-a1f8-099b5ad65b39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.utils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:07 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f73ad1-c108-402f-8f8d-6b236b0505e0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG os_brick.utils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updating existing volume attachment record: 7f8201d8-3be8-4b15-a85b-012d9dd87d2a {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a27f88-aa3c-437e-bb13-d0d98350568e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[023c0315-b513-4755-a83f-18a1c9a8c978]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b962128-8dc0-4199-8cf3-c983556bfee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d06ca-1b5d-4db6-b4c4-e31b46cf4fac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:08 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[78189d00-5fbb-4e11-97b5-89d2d2a101f0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:08 user nova-compute[86931]: DEBUG os_brick.utils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:08 user nova-compute[86931]: INFO nova.compute.manager [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Swapping volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c for 252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-changed-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing instance network info cache due to event network-changed-83c9ef40-990a-44af-a396-98a5de566b42. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing network info cache for port 83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updated VIF entry in instance network info cache for port 83c9ef40-990a-44af-a396-98a5de566b42. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96fa4940-8e8b-4cbb-b0ff-f08bdc42e5e6 req-78e88e0c-6e94-4bbc-bfd0-af4613a9b0dd service nova] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'pci_requests' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.objects.base [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Object Instance<7269c7b0-d837-4201-8695-83eeb7c7824f> lazy-loaded attributes: flavor,pci_requests {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:24:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:24:12 user nova-compute[86931]: DEBUG nova.policy [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c6d9ee1c274f6fae59529b07f83b12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c91d63d28847aa9d297f9c03c4af2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:24:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Successfully created port: 79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dywnbQrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:13 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:13 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:13 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3077e-5c22-4a4d-b5e4-d0179b87bdb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:13 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3484b65a-d62a-4254-b528-7883a4322977]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280] added
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a3cf1c-6bea-4100-859c-4e7adc0d0787]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc57308-a16e-491a-9dff-d1bc1838cbf4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dywnbQrG {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dywnbQrG" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e4a8f-e453-4964-adf8-0d23bb7a14ab]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dywnbQrG'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[31279696-e69e-4498-99a7-888459ae0f92]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[471033d5-a26e-4b3a-8ab0-92381dbedf0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Successfully updated port: 79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-changed-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing instance network info cache due to event network-changed-79db1954-0b19-4cf0-9761-25ff2c342044. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3834b7f-741d-4298-91f0-6e12cb3c0d7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260]
Nov 16 19:24:13 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[73005317-eb9d-431e-8991-ef29f25a9aa5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ff5d6-9e85-4a07-8b8a-ab9273b0ba39]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:13 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7651f-bf79-4d51-9084-c728e7ca3416]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dywnbQrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'serial': '252347c0-102b-4a8d-b6ec-9efd82c2eb90'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'serial'} {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:13 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Refreshing network info cache for port 79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_vif [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '107bde3d-e194-584a-bb9b-5e23d6b8f4f5', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79db1954-0b, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79db1954-0b, col_values=(('qos', UUID('cd9284fd-f41d-4a7d-ba52-763c4406af0a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79db1954-0b, col_values=(('external_ids', {'iface-id': '79db1954-0b19-4cf0-9761-25ff2c342044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9b:10', 'vm-uuid': '7269c7b0-d837-4201-8695-83eeb7c7824f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: INFO os_vif [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b')
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] attach device xml: <interface type="ethernet">
Nov 16 19:24:14 user nova-compute[86931]:   <mac address="fa:16:3e:c9:9b:10"/>
Nov 16 19:24:14 user nova-compute[86931]:   <model type="virtio"/>
Nov 16 19:24:14 user nova-compute[86931]:   <mtu size="1442"/>
Nov 16 19:24:14 user nova-compute[86931]:   <target dev="tap79db1954-0b"/>
Nov 16 19:24:14 user nova-compute[86931]: </interface>
Nov 16 19:24:14 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-changed-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Refreshing instance network info cache due to event network-changed-8c8f88f6-9aea-4745-ab36-1bae32a5fd44. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] Acquiring lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] Acquired lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Refreshing network info cache for port 8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23237326161336464', 'path': '/dev/sdi'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237326161336464', 'path': '/dev/sdi'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.826s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:14 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:14 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[28794919-ecbe-49f2-875d-b35e4d64c8cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:14 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lazy-loading 'flavor' on Instance uuid f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a879d7-6662-4ec6-a652-7ff14ad7e21f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90] added
Nov 16 19:24:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:24:14 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:14 user nova-compute[86931]:   <source dev="/dev/sdi"/>
Nov 16 19:24:14 user nova-compute[86931]:   <target dev="sdc" bus="scsi"/>
Nov 16 19:24:14 user nova-compute[86931]:   <serial>5a667758-c1bd-4f62-99ed-4c465a1af280</serial>
Nov 16 19:24:14 user nova-compute[86931]:   <address type="drive" controller="0" unit="2"/>
Nov 16 19:24:14 user nova-compute[86931]: </disk>
Nov 16 19:24:14 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f276cac-0319-4f6c-b73a-7e167a6b4fb0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name hda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No VIF found with MAC fa:16:3e:47:4f:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c987a3cc-34f9-4f6b-b226-ae7721879690]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDwlvrkb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:24:14 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:24:14</nova:creationTime>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:24:14 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:24:14 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:owner>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:24:14 user nova-compute[86931]:   </nova:owner>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:24:14 user nova-compute[86931]:   <nova:ports>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:24:14 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:24:14 user nova-compute[86931]:     </nova:port>
Nov 16 19:24:14 user nova-compute[86931]:     <nova:port uuid="79db1954-0b19-4cf0-9761-25ff2c342044">
Nov 16 19:24:14 user nova-compute[86931]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Nov 16 19:24:14 user nova-compute[86931]:     </nova:port>
Nov 16 19:24:14 user nova-compute[86931]:   </nova:ports>
Nov 16 19:24:14 user nova-compute[86931]: </nova:instance>
Nov 16 19:24:14 user nova-compute[86931]:  {{(pid=86931) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDwlvrkb" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec5433-f382-425e-a8b0-f5f3b91aa917]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDwlvrkb'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a4254-52f0-4c0c-9697-578df908df7f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updated VIF entry in instance network info cache for port 79db1954-0b19-4cf0-9761-25ff2c342044. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d70c8768-00e3-43a3-a921-b47598db737c tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.035s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d39c173-cd55-4364-8405-6315a78bdfa1 req-984adaba-dca0-42dc-996f-faf9f0157378 service nova] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c1fba-f845-4268-9e57-ad93f4616c71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:14 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-changed-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Refreshing instance network info cache due to event network-changed-bec091bb-3963-4c71-9dec-aa44ebaf4a7b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] Acquiring lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] Acquired lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Refreshing network info cache for port bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --login" returned: 0 in 0.134s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf968c-529d-4cf0-8fcc-d35a9ded852d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260]
Nov 16 19:24:14 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6df7d5-995f-45ec-9923-a043cfa7e63b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4bfb2-8180-4804-bd79-dcf251269ff3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:15 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b454e-44c0-4df4-b02e-e5745e500f92]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updated VIF entry in instance network info cache for port 8c8f88f6-9aea-4745-ab36-1bae32a5fd44. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating instance_info_cache with network_info: [{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f976a0ee-287d-4131-af46-23de6c392c5c req-b6d682a7-65a1-43ba-95a6-4502ffd724c2 service nova] Releasing lock "refresh_cache-e6311dce-9836-41b2-bfc2-c65262aa3012" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No BDM found with device name sda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No BDM found with device name sdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No BDM found with device name sdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] No VIF found with MAC fa:16:3e:69:98:36, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lazy-loading 'flavor' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updated VIF entry in instance network info cache for port bec091bb-3963-4c71-9dec-aa44ebaf4a7b. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updating instance_info_cache with network_info: [{"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5aa19429-87e4-4ee3-94b7-9c1dfbc4e8ec tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.655s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad52f62d-0d3e-420b-9506-a36d09aa4bd8 req-4aa7a67b-1a8d-495f-834d-5ee8f6fd3d71 service nova] Releasing lock "refresh_cache-782a1af8-63f6-4630-b5e2-5819e75c1673" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:15 user nova-compute[86931]: INFO nova.compute.manager [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Attaching volume 3ddd5aec-267d-4cba-81de-3858ad3c1077 to /dev/vdb
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:15 user nova-compute[86931]: INFO nova.compute.manager [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Attaching volume b3774656-d32d-4f03-af75-c664b337e369 to /dev/vdb
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.utils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db711063-e345-4f20-81a8-ae31d715f1d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3ac79d-58af-4cb6-a0ac-a2abf7129b01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.utils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7ba6d-43d1-4508-80bb-25b144fdf5cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ca85f-6890-42cf-a9cd-91c16a3fbc62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8803b-d61d-4bef-b818-1558084bf87d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:15 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[26060c4a-078d-4a9c-875e-8aea9de8e71c]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.utils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating existing volume attachment record: 3deceb9a-4799-43c0-8441-bfcf29112fc0 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c288aac8-6c70-4c8b-99a1-06890c2ddd12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a6ba9-381c-4dbb-8178-2119b7e9476c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641db95-6614-4d58-8ee0-63d1e45be424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:15 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[980067e2-a94a-4432-acec-d7ff60cfc209]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG os_brick.utils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updating existing volume attachment record: 11c4202a-bf44-4785-9792-583f0c26629d {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:15 user nova-compute[86931]: INFO nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Rebuilding instance
Nov 16 19:24:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== connect_volume: return (2347ms) {'type': 'block', 'scsi_wwn': '26664656235633664', 'path': '/dev/sdj'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664656235633664', 'path': '/dev/sdj'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lazy-loading 'flavor' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:16 user nova-compute[86931]: WARNING nova.compute.manager [req-05b443df-848d-41be-b885-97b0b2283be3 req-dbe5ff64-903a-4b9d-913f-d61eb5297eff service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state active and task_state rebuilding.
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:16 user nova-compute[86931]: WARNING nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 for instance with vm_state active and task_state None.
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:16 user nova-compute[86931]: WARNING nova.compute.manager [req-e3773070-6fe3-467a-9eaa-3dfa6ea4ed84 req-6423147a-909c-4e10-b4ba-6e4b0399a182 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 for instance with vm_state active and task_state None.
Nov 16 19:24:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance destroyed successfully.
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance destroyed successfully.
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-488420017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8f88f6-9a, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50016281-2b4b-4f4e-80e0-66b0f928d63b) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 142606336 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.compute.manager [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Detaching volume 5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:17 user nova-compute[86931]: INFO os_vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a')
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8370e2c-3481-4ab8-8cc7-4791d4c040d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]: iSNS:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]: STATIC:
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:17 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:17 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d58ff-8c04-4a66-990e-852a0e92e26e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.virt.block_device [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Attempting to driver detach volume 5a667758-c1bd-4f62-99ed-4c465a1af280 from mountpoint /dev/sdc
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Attempting to detach device sdc from instance f36e7459-f870-4c1c-b45f-102a09370f04 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:17 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:17 user nova-compute[86931]:   <source dev="/dev/sdi"/>
Nov 16 19:24:17 user nova-compute[86931]:   <target dev="sdc" bus="scsi"/>
Nov 16 19:24:17 user nova-compute[86931]:   <serial>5a667758-c1bd-4f62-99ed-4c465a1af280</serial>
Nov 16 19:24:17 user nova-compute[86931]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 19:24:17 user nova-compute[86931]: </disk>
Nov 16 19:24:17 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Successfully detached device sdc from instance f36e7459-f870-4c1c-b45f-102a09370f04 from the persistent domain config.
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f36e7459-f870-4c1c-b45f-102a09370f04 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:17 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:17 user nova-compute[86931]:   <source dev="/dev/sdi"/>
Nov 16 19:24:17 user nova-compute[86931]:   <target dev="sdc" bus="scsi"/>
Nov 16 19:24:17 user nova-compute[86931]:   <serial>5a667758-c1bd-4f62-99ed-4c465a1af280</serial>
Nov 16 19:24:17 user nova-compute[86931]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 19:24:17 user nova-compute[86931]: </disk>
Nov 16 19:24:17 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dac367-b2da-4d67-91fe-320cd45ca7f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c6b4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacee4ea-44f4-4fb6-b738-d1d7a504e46a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[40685806-4b6e-4b49-b7c5-835893d2c7a2]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba4a59f-8dbd-4beb-9d0c-d542f0b25180]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ff823-e131-48b3-84b7-2389975fdba0]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806e8f1-2af4-4db9-b53a-57cb17b21e8d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06ed058-feda-4a7c-a113-08676f2c2325]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]
Nov 16 19:24:17 user nova-compute[86931]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dff2604-fbf1-4cf4-8503-916239edc414]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== disconnect_volume: return (431ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deleting instance files /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012_del
Nov 16 19:24:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deletion of /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012_del complete
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 278921216 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e6311dce-9836-41b2-bfc2-c65262aa3012 could not be found.
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bb496a-67dd-4f3d-a910-cb4562028318]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]: iSNS:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]: STATIC:
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:17 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:17 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:17 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:17 user nova-compute[86931]: No targets found.
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:17 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:17 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d380b7b-7265-483b-a5ee-8c2928905ab0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[00853245-e562-4fad-9517-a9da6e32e24e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:17 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c6b5750>, {}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Disconnecting from: [] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.121s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== disconnect_volume: return (122ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 408944640 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:18 user nova-compute[86931]: WARNING nova.compute.manager [req-31e55a33-61bc-4f1c-9881-2d3ba56ff58d req-430c3490-8c85-45d2-904e-c32030b83eb6 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state active and task_state rebuilding.
Nov 16 19:24:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 493879296 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 638582784 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Preparing to wait for external event volume-reimaged-0b692075-47b9-49ff-931a-c612d8ff61a5 {{(pid=86931) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 850395136 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 942669824 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 1065353216 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:21 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[370dff3d-e3da-4f49-95e9-a448c9b23cd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:21 user nova-compute[86931]: No targets found.
Nov 16 19:24:21 user nova-compute[86931]: iSNS:
Nov 16 19:24:21 user nova-compute[86931]: No targets found.
Nov 16 19:24:21 user nova-compute[86931]: STATIC:
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:21 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:21 user nova-compute[86931]: No targets found.
Nov 16 19:24:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:21 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:21 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7fb05-be28-4525-ad11-ad0fa218a0b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee98287-ff00-49bb-a236-52dc027e72ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:21 user nova-compute[86931]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c4cc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c'): ({'sdh'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Removing single pathed devices sdh {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b45fd-d2a9-4e66-8976-f62c8c9ddfa7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b23e1ef-1a02-4087-a4c9-15231e983842]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Flushing IO for device /dev/sdh {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25679d2-62fb-4df1-80ff-1268960280c3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5dd31-14b8-4f15-904d-7ada54f7a33d]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf3b6c-9026-40b1-901c-8b0c4ccc9021]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14f2fd5-44ed-4132-9c66-42ae479f8e98]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]
Nov 16 19:24:22 user nova-compute[86931]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9acf8d-6273-45f3-99f4-c6c9a99317a7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== disconnect_volume: return (330ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'serial'} {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: removing Cinder connection for volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqgXzvDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:22 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:22 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:22 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[83503565-4465-4520-bcda-53c9ebc97ec0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:22 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3f8f6-56ea-4dff-9515-e03ac793d074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077] added
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2281d-9d9e-4d89-af57-b02428c1b09c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[443501e0-76ff-415b-bb2b-32696f60c4f0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqgXzvDN {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqgXzvDN" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[96de1b44-ae27-4a0e-8bd9-6816abb05f64]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqgXzvDN'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3394d-7091-486e-bd73-c307ee050122]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c626c4-19ed-48ea-8d75-a9abcdd6c216]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162a610-cc3d-4e09-a131-1b93140e3dc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260]
Nov 16 19:24:22 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d79b2e-26da-4796-b787-5c2ead26a1d2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e522e7a-11d7-4eef-86f7-fc635b708f87]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d126c0f-7433-40c3-9410-df49d1d768cf]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: Updating volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aDwlvrkb", "auth_password": "liWvkYZmR0p5Ar", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "252347c0-102b-4a8d-b6ec-9efd82c2eb90"}, "status": "reserved", "instance": "b4834f6f-9cdd-450e-bf08-e49d353c3574", "attached_at": "", "detached_at": "", "volume_id": "252347c0-102b-4a8d-b6ec-9efd82c2eb90", "serial": "252347c0-102b-4a8d-b6ec-9efd82c2eb90"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'no_device': None, 'attachment_id': 'e53c0923-740b-414f-95ef-1be5b62eb435'} {{(pid=86931) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-15251cc3-2aa6-4fb7-8bc6-854a9559fb46 tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.331s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e16458c7-133e-4424-bc89-018f28f6a546 is timed out.
Nov 16 19:24:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully detached device vdb from instance e16458c7-133e-4424-bc89-018f28f6a546 from the live domain config.
Nov 16 19:24:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGAIULvH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:23 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPBLsRTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:23 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqgXzvDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26330613638343539', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330613638343539', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.698s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.objects.instance [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[de225ff5-c0f8-4835-b8ac-5f52b1608248]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:24 user nova-compute[86931]: No targets found.
Nov 16 19:24:24 user nova-compute[86931]: iSNS:
Nov 16 19:24:24 user nova-compute[86931]: No targets found.
Nov 16 19:24:24 user nova-compute[86931]: STATIC:
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:24 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:24 user nova-compute[86931]: No targets found.
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:24 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:24 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:24:24 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:24 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:24:24 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:24 user nova-compute[86931]:   <serial>3ddd5aec-267d-4cba-81de-3858ad3c1077</serial>
Nov 16 19:24:24 user nova-compute[86931]: </disk>
Nov 16 19:24:24 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f1c493-45cb-4a72-be10-ac8d46b8625e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a962fb-5a77-4a33-a1fb-a10945d526dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c4cc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4'): ({'sdg'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Removing single pathed devices sdg {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b0361-c17b-4793-a1b5-1b357b6c78a9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51158b-5250-4c4b-af6b-b7b4634f136e]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Flushing IO for device /dev/sdg {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f39d0-37b8-453b-bd43-bb0071d0f7a4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a9eb3-a1f7-406c-9481-64b57ed7fbfb]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fca4222-f574-40ad-826e-1191b755dfb7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3960e-2c8e-4c3d-a6b6-90857c1df822]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260]
Nov 16 19:24:24 user nova-compute[86931]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbeb76ec-8ba8-47f5-a298-e8fadfdfcde4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b9a00-d657-4bed-83c0-1cc69e67f48e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] <== disconnect_volume: return (1035ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.990s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:24 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:24 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60c003-e43a-417a-b44e-6207e4db49c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:24 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f1a03-09db-4ab4-986a-efe4ece6273a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369] added
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.utils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b0716-46dd-4436-856d-b27cebeccc5d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0542b65f-2cf8-44ff-962e-cae25ae7f353]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b4c17-7c95-4df9-97e9-af5f7fa67c0c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPBLsRTW {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[25605bb5-13ea-4441-827a-70c323bbc025]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No BDM found with device name hda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] No VIF found with MAC fa:16:3e:47:4f:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bPBLsRTW" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7d1f0-fb92-4ca1-acc3-bbc1cc7ee900]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bPBLsRTW'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a2025-5274-45ec-bfa5-811d6ad8dd02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe5d34-92a2-4ed8-a418-01902b5dd35f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd211e0-d28c-433e-90a0-ff31fa05a0f7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:24 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10304b-c4f7-4408-b22a-1e16a334fa5d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.utils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c340d22-6033-479a-867c-ad97e7375394]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d40a7-4837-4e8a-8bdd-e4ae55be6394]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260]
Nov 16 19:24:24 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: INFO nova.compute.manager [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Swapping volume 252347c0-102b-4a8d-b6ec-9efd82c2eb90 for a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-04a7637a-3d31-442b-8305-76f5ab362a75 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.188s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b34b8a-67bb-4cc2-9f2d-604b9ecdf98b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[259cad92-3d7e-408e-a659-868f107dad07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6b9f4-1f34-4b6c-91c1-ed5a7a4dddd7]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'flavor' on Instance uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7ed6c072-fee3-4615-9ca7-94f07420bc82 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.412s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPBLsRTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] <== connect_volume: return (2415ms) {'type': 'block', 'scsi_wwn': '23133623161373633', 'path': '/dev/sdg'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133623161373633', 'path': '/dev/sdg'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lazy-loading 'flavor' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 19:24:25 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:25 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:25 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:25 user nova-compute[86931]:   <serial>b3774656-d32d-4f03-af75-c664b337e369</serial>
Nov 16 19:24:25 user nova-compute[86931]: </disk>
Nov 16 19:24:25 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:24:25 user nova-compute[86931]: INFO nova.compute.manager [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Detaching volume 3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:25 user nova-compute[86931]: INFO nova.virt.block_device [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Attempting to driver detach volume 3ddd5aec-267d-4cba-81de-3858ad3c1077 from mountpoint /dev/vdb
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Attempting to detach device vdb from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:25 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:25 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:24:25 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:25 user nova-compute[86931]:   <serial>3ddd5aec-267d-4cba-81de-3858ad3c1077</serial>
Nov 16 19:24:25 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:24:25 user nova-compute[86931]: </disk>
Nov 16 19:24:25 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully detached device vdb from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the persistent domain config.
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:25 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:25 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:24:25 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:25 user nova-compute[86931]:   <serial>3ddd5aec-267d-4cba-81de-3858ad3c1077</serial>
Nov 16 19:24:25 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:24:25 user nova-compute[86931]: </disk>
Nov 16 19:24:25 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] No VIF found with MAC fa:16:3e:18:f6:74, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82f1c3b4-1a27-4d7e-9f33-91099a61b2cb tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.802s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] volume_snapshot_create: create_info: {'snapshot_id': '831035dd-1dd4-4c6d-b5d8-f8a0378ce7b0', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=86931) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] snap xml: <domainsnapshot>
Nov 16 19:24:27 user nova-compute[86931]:   <disks>
Nov 16 19:24:27 user nova-compute[86931]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 16 19:24:27 user nova-compute[86931]:       <source file="/dev/new_file"/>
Nov 16 19:24:27 user nova-compute[86931]:     </disk>
Nov 16 19:24:27 user nova-compute[86931]:     <disk name="vda" snapshot="no"/>
Nov 16 19:24:27 user nova-compute[86931]:   </disks>
Nov 16 19:24:27 user nova-compute[86931]: </domainsnapshot>
Nov 16 19:24:27 user nova-compute[86931]:  {{(pid=86931) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] Lazy-loading 'system_metadata' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     rv = execute(f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     six.reraise(c, e, tb)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     raise value
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     rv = meth(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     self._volume_snapshot_create(context, instance, guest,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     rv = execute(f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     six.reraise(c, e, tb)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     raise value
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     rv = meth(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] 
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72155f0a-532e-441e-b6b5-ded1a12e4870 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] volume_snapshot_delete: delete_info: {'volume_id': 'b3774656-d32d-4f03-af75-c664b337e369'} {{(pid=86931) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [None req-72155f0a-532e-441e-b6b5-ded1a12e4870 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673]     if delete_info['type'] != 'qcow2':
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] KeyError: 'type'
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 831035dd-1dd4-4c6d-b5d8-f8a0378ce7b0 could not be found.
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 831035dd-1dd4-4c6d-b5d8-f8a0378ce7b0 could not be found. (HTTP 404) (Request-ID: req-ad89d3a2-a2ca-48ef-8838-a86e359b1743)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 831035dd-1dd4-4c6d-b5d8-f8a0378ce7b0 could not be found.
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server [None req-c78d80c5-3f0c-45b1-80e4-79c91aeb63e0 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver [None req-72155f0a-532e-441e-b6b5-ded1a12e4870 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-71b4db71-7763-4c15-b8b1-be337a1f1b67)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 19:24:27 user nova-compute[86931]: ERROR nova.virt.libvirt.driver 
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server [None req-72155f0a-532e-441e-b6b5-ded1a12e4870 tempest-VolumesAssistedSnapshotsTest-1584662125 tempest-VolumesAssistedSnapshotsTest-1584662125-project] Exception during message handling: KeyError: 'type'
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 19:24:27 user nova-compute[86931]: ERROR oslo_messaging.rpc.server 
Nov 16 19:24:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:27 user nova-compute[86931]: INFO nova.compute.manager [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Detaching volume b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:27 user nova-compute[86931]: INFO nova.virt.block_device [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Attempting to driver detach volume b3774656-d32d-4f03-af75-c664b337e369 from mountpoint /dev/vdb
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Attempting to detach device vdb from instance 782a1af8-63f6-4630-b5e2-5819e75c1673 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:27 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:27 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:27 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:27 user nova-compute[86931]:   <serial>b3774656-d32d-4f03-af75-c664b337e369</serial>
Nov 16 19:24:27 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:27 user nova-compute[86931]: </disk>
Nov 16 19:24:27 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Successfully detached device vdb from instance 782a1af8-63f6-4630-b5e2-5819e75c1673 from the persistent domain config.
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 782a1af8-63f6-4630-b5e2-5819e75c1673 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:27 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:27 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:24:27 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:27 user nova-compute[86931]:   <serial>b3774656-d32d-4f03-af75-c664b337e369</serial>
Nov 16 19:24:27 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:27 user nova-compute[86931]: </disk>
Nov 16 19:24:27 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'serial': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90'}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'serial'} {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:30 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:30 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:30 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b3d882-636d-435e-bbd8-db792dcea319]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:30 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff01cff-095e-46ef-ab4c-f71737d0ca05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c] added
Nov 16 19:24:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2d6c37-7202-48a0-8ee2-f600d379a097]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[780bcf2b-0424-4589-bf0c-4242ab675aad]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrcenduY {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrcenduY" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce137e-c8cc-4e64-be41-9085663afed5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrcenduY'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc6d30-9e4a-4e72-bfe6-8b93fa379340]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b870d8f-5789-40f7-bf43-5d8019749a2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6f4b3-b50e-4106-8fe0-227394d0a0ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]
Nov 16 19:24:31 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa0716c-f906-44bd-917e-4047fb5885fc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707d7dc-175c-4165-b175-f6ad7a8a32f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c34540-4e75-4a4e-8be3-3b70da3fea19]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23234323136346134', 'path': '/dev/sdk'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234323136346134', 'path': '/dev/sdk'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG nova.objects.instance [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lazy-loading 'flavor' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 37748736 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 209715200 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 363855872 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd req-002147d5-7a76-41f2-a145-683b99a40ef8 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event volume-reimaged-0b692075-47b9-49ff-931a-c612d8ff61a5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd req-002147d5-7a76-41f2-a145-683b99a40ef8 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd req-002147d5-7a76-41f2-a145-683b99a40ef8 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd req-002147d5-7a76-41f2-a145-683b99a40ef8 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd req-002147d5-7a76-41f2-a145-683b99a40ef8 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Processing event volume-reimaged-0b692075-47b9-49ff-931a-c612d8ff61a5 {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 19:24:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:24:35 user nova-compute[86931]: INFO nova.virt.block_device [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Booting with volume 0b692075-47b9-49ff-931a-c612d8ff61a5 at /dev/vda
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.utils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5746b-7854-46db-9ef8-71731fa562ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0241b8e-b1e2-483e-b2a4-32b614cee035]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[881bb9e7-f319-42f1-bb2f-6d25ea726f1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f07e7-9156-4a8a-8669-9bb2e1299c11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 533725184 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:35 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f669105-08b8-4a38-94e7-fe2608987b87]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG os_brick.utils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating existing volume attachment record: def7b9ae-615e-4fba-a3ba-bff5595e7898 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 650117120 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 791674880 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-changed-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing instance network info cache due to event network-changed-38c945f9-d08b-4088-90f5-82ed86eb9472. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] Acquiring lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] Acquired lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Refreshing network info cache for port 38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:24:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 980418560 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updated VIF entry in instance network info cache for port 38c945f9-d08b-4088-90f5-82ed86eb9472. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2b8716f-39d9-42cd-ace7-93f89a2af796 req-ea69aa03-451b-4346-bba8-ce34a1ed5513 service nova] Releasing lock "refresh_cache-b35d0170-ff37-4a3d-b748-47778fd4accf" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDwlvrkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '252347c0-102b-4a8d-b6ec-9efd82c2eb90'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:37 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb418987-7b78-49ea-9a82-f1ff4fbdab7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]: iSNS:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]: STATIC:
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:37 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:37 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a0ceb-cda5-477f-a354-ca26d7cd283e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0996b8-3084-4d14-b35a-3e8120447bc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c180820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90'): ({'sdj'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Removing single pathed devices sdj {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f36e7459-f870-4c1c-b45f-102a09370f04 is timed out.
Nov 16 19:24:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Successfully detached device sdc from instance f36e7459-f870-4c1c-b45f-102a09370f04 from the live domain config.
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7433df2-4e54-423d-9e9f-0de727b6b45f]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dywnbQrG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:37 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adbeace-d07d-4dda-ac76-2fb0eaf07895]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Flushing IO for device /dev/sdj {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ccc36-74d0-4955-9914-bb0fb339891b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bfffdd-576e-4ca0-9127-fee01406455c]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] SCSI volumes sdj have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ba3993-298c-4c39-993d-04b2f749b6a2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b754a-eef5-4d05-844e-f7c745a1866e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260]
Nov 16 19:24:37 user nova-compute[86931]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:252347c0-102b-4a8d-b6ec-9efd82c2eb90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a3bfb-fadf-428e-8b06-3fecbb4edde3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] <== disconnect_volume: return (370ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.241s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[824ff4ce-6709-4354-90ae-28055a92d200]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]: iSNS:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]: STATIC:
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:37 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:37 user nova-compute[86931]: No targets found.
Nov 16 19:24:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:37 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:37 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510c490-b4f5-4cd0-9ce9-0f77bc727400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7462a623-7def-42ad-a64b-1be937ac7fc5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c180e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280'): ({'sdi'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Removing single pathed devices sdi {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'b4834f6f-9cdd-450e-bf08-e49d353c3574', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'serial'} {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: removing Cinder connection for volume 252347c0-102b-4a8d-b6ec-9efd82c2eb90 {{(pid=86931) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f15fd1-1263-4e5a-a799-dd94d3ed2041]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285abcd-a0d1-44c0-8b57-84dc3c7fd635]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Flushing IO for device /dev/sdi {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd985db-0aad-402c-9212-0392dbd227ea]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced4ddb-aae0-4dbb-ae80-d820d72378f4]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] SCSI volumes sdi have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25fc85-4158-4b98-aabf-1e118b4d4f50]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59855e8-e7ae-4bc0-bc2e-8a171d525f77]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260]
Nov 16 19:24:38 user nova-compute[86931]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a667758-c1bd-4f62-99ed-4c465a1af280 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f8539d-de9f-4669-9756-2e490011ca94]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] <== disconnect_volume: return (609ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lazy-loading 'flavor' on Instance uuid f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-13ebcf98-5288-4363-b2fc-274844db1b56 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.165s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:39 user nova-compute[86931]: INFO nova.compute.manager [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Terminating instance
Nov 16 19:24:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:40 user nova-compute[86931]: INFO nova.compute.manager [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Terminating instance
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-4a99387a-be1c-4d4e-9373-7a0ff0b3bf33 req-b4fccad9-4b89-4edf-880d-4dbca032eb6f service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-38c945f9-d08b-4088-90f5-82ed86eb9472 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-unplugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] No waiting events found dispatching network-vif-unplugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-74676af3-dfa2-4e4e-9a88-64f92f530eca req-003b0e67-4983-4dcb-b15b-967046460611 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-unplugged-4b6e21ac-041b-49a7-a569-059d0e03d511 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-0359821a-dbe2-4332-bf9c-23eaa598c4d8 req-0067db78-cb91-40b5-9716-c80397f42cbb service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Instance destroyed successfully.
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lazy-loading 'resources' on Instance uuid f36e7459-f870-4c1c-b45f-102a09370f04 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2006905742',display_name='tempest-AttachSCSIVolumeTestJSON-server-2006905742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2006905742',id=7,image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3WqYDR2ZeM9JTj7YlD8HE0+VbsRUup4lRRt/bvLqi94xNZN5dHI51/NBGACaB9ojaEPT5XM3a1lUx1Cc5L/0DeTAHLNIRDWD59PRok0JNIb7tPjZu5SKzuyHx2yO4fXg==',key_name='tempest-keypair-312958567',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5196e040960b457983e45ae2a59d014d',ramdisk_id='',reservation_id='r-1gxfescb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fd7ec2c3-16e4-4ba1-b68a-7e4283fb173f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1150846559',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1150846559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='650e415b8bee442f8e5ed3d35356042c',uuid=f36e7459-f870-4c1c-b45f-102a09370f04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converting VIF {"id": "4b6e21ac-041b-49a7-a569-059d0e03d511", "address": "fa:16:3e:69:98:36", "network": {"id": "500e2ecc-e3d6-401a-be55-c0b13121e178", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1531985594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5196e040960b457983e45ae2a59d014d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6e21ac-04", "ovs_interfaceid": "4b6e21ac-041b-49a7-a569-059d0e03d511", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG os_vif [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b6e21ac-04, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1032405-2fb6-46b3-a69a-5a30e2c4d2ff) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: INFO os_vif [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:98:36,bridge_name='br-int',has_traffic_filtering=True,id=4b6e21ac-041b-49a7-a569-059d0e03d511,network=Network(500e2ecc-e3d6-401a-be55-c0b13121e178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6e21ac-04')
Nov 16 19:24:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Deleting instance files /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04_del
Nov 16 19:24:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Deletion of /opt/stack/data/nova/instances/f36e7459-f870-4c1c-b45f-102a09370f04_del complete
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: INFO nova.compute.manager [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:24:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Instance destroyed successfully.
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lazy-loading 'resources' on Instance uuid b35d0170-ff37-4a3d-b748-47778fd4accf {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38c945f9-d0, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4cb144e-8cb0-44ea-9b29-cdeef833ca3d) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b8:8a,bridge_name='br-int',has_traffic_filtering=True,id=38c945f9-d08b-4088-90f5-82ed86eb9472,network=Network(cbb677ab-7132-4b05-9d8a-9d18a854adce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38c945f9-d0')
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4b8cb5a-7e, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66cc7863-e5d8-4a53-a441-4d0eafaab241) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:83:15,bridge_name='br-int',has_traffic_filtering=True,id=e4b8cb5a-7eb3-43aa-8945-fc14827af191,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4b8cb5a-7e')
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66133fec-c9, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-38c945f9-d08b-4088-90f5-82ed86eb9472 for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-acb774fa-b662-4388-a7be-89d99ea0597f req-757c6ca2-e578-4016-90ed-9cfa1950f748 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-1121d492-f35c-4c80-84c0-ca6fd568bcc9 for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8df27ee-0e73-49ef-adaf-5e7b1790ee02) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c0:55,bridge_name='br-int',has_traffic_filtering=True,id=66133fec-c906-4f0a-8c2f-41b27c30e4fa,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66133fec-c9')
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap426031cc-fe, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0fce36e-2d05-4eb4-b5ab-6f0fa2e5125d) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e9:a2,bridge_name='br-int',has_traffic_filtering=True,id=426031cc-fe4e-471f-ba51-af89f3b4e011,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426031cc-fe')
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f8918dd-1a, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] Acquiring lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] Lock "f36e7459-f870-4c1c-b45f-102a09370f04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] No waiting events found dispatching network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-322a40b1-5f70-4fe1-ae10-8397372dd424 req-c0bbdb1d-e532-49fb-ac50-6dc62e6e30e8 service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received unexpected event network-vif-plugged-4b6e21ac-041b-49a7-a569-059d0e03d511 for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-e4b8cb5a-7eb3-43aa-8945-fc14827af191 for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-66133fec-c906-4f0a-8c2f-41b27c30e4fa for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-426031cc-fe4e-471f-ba51-af89f3b4e011 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-426031cc-fe4e-471f-ba51-af89f3b4e011 for instance with vm_state active and task_state deleting.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-733cba70-6508-422b-8ac0-95c9cb898621 req-6e214842-d888-4ba6-acd8-95bf93b26499 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ef49a73-a72d-4751-b418-9b4243f233f1) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Took 1.41 seconds to deallocate network for instance.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=25.516632080078125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:42 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:a7:07,bridge_name='br-int',has_traffic_filtering=True,id=2f8918dd-1a9f-45f8-9c74-1b33ea5901c3,network=Network(c111fa1e-aeb1-4d73-8f56-4706d1fa0841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8918dd-1a')
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:42 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1121d492-f3, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a57d2dd5-fa69-4acf-a7f1-e507c2ff4c75) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1121d492-f35c-4c80-84c0-ca6fd568bcc9,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1121d492-f3')
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-891382957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-891382957',id=11,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJXgzd1eg9ZpdO1J7oflkP1ga/Mfs8muUT6BuFZ/QUecpn68n4MfS0PHsdCmmHYI4FuP0t1We24XJfNSxy+8Rx9tY8OY2v+glw4yszuzj4rZFPh1J4puukuKj8oLZwv5w==',key_name='tempest-keypair-1655645798',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e66d5d6b5dc4d99901e64aa6b9562f1',ramdisk_id='',reservation_id='r-lrc66hfo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2112492756',owner_user_name='tempest-TaggedBootDevicesTest_v242-2112492756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c34c4a7db2c84261bf0064cd71cef244',uuid=b35d0170-ff37-4a3d-b748-47778fd4accf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converting VIF {"id": "c8024acd-1d97-429e-b36b-4ab162b2da31", "address": "fa:16:3e:b9:3f:8f", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024acd-1d", "ovs_interfaceid": "c8024acd-1d97-429e-b36b-4ab162b2da31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8024acd-1d, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=659674e5-caf4-4a22-84cf-2cf56fb5034c) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:43 user nova-compute[86931]: INFO os_vif [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3f:8f,bridge_name='br-int',has_traffic_filtering=True,id=c8024acd-1d97-429e-b36b-4ab162b2da31,network=Network(477b05a2-6963-47f9-a121-684d2569d411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024acd-1d')
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCgJnDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b4834f6f-9cdd-450e-bf08-e49d353c3574 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f36e7459-f870-4c1c-b45f-102a09370f04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7269c7b0-d837-4201-8695-83eeb7c7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e6311dce-9836-41b2-bfc2-c65262aa3012 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 782a1af8-63f6-4630-b5e2-5819e75c1673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b35d0170-ff37-4a3d-b748-47778fd4accf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5774451a-b8a5-46b8-b6b5-81f49a50d4a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: iSNS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: STATIC:
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:43 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[268eb7df-5504-4eb9-a8d4-b746f0b109b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a688128-b984-42eb-858f-4eea77b6bafc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c4cdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae91ee2-6a9b-478b-a0bf-ece0bf9a1ec7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7fdd6f-e307-42e1-b60c-fcad794bd47f]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e94725-ef9b-4c84-bcf0-a3f8438afa7d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8358cd3-c073-4fd7-8084-44a22ba34667]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[53657f85-4417-446c-a0b5-c0403b03f9e3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bb36d-e745-40b4-b42d-3047f639eee4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260]
Nov 16 19:24:43 user nova-compute[86931]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.422s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6f616b-7b16-4efb-9fc4-04d1983d8b46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[02355b85-67d2-4daa-9cb1-a685f0f2d03b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== disconnect_volume: return (370ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OUfybjhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[76226751-17bf-406a-89e0-e6bad701e305]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: iSNS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: STATIC:
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:43 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[402bc7e1-6c3f-412f-93f8-1a625f05ef04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398c2fa-90a5-48cc-9ba6-52149a80b0a8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c1c5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] swap_volume: Updating volume 252347c0-102b-4a8d-b6ec-9efd82c2eb90 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DrcenduY", "auth_password": "opixRhDwu1Gf8b", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "a1c652c0-45d9-47bd-8108-cf96fd0b9a8c"}, "status": "reserved", "instance": "b4834f6f-9cdd-450e-bf08-e49d353c3574", "attached_at": "", "detached_at": "", "volume_id": "a1c652c0-45d9-47bd-8108-cf96fd0b9a8c", "serial": "a1c652c0-45d9-47bd-8108-cf96fd0b9a8c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'no_device': None, 'attachment_id': 'f6f61946-36f8-4314-b06a-7959e4ff6c0f'} {{(pid=86931) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[22df57c9-de4b-411d-a77e-8a8dc0f9dcfa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-27dad85f-f502-45dd-976d-c01b74d2305c tempest-TestVolumeSwap-1010014674 tempest-TestVolumeSwap-1010014674-project-admin] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.223s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[935669ca-f1fe-4ceb-8a1d-7411587d40c5]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1b298-15be-40ac-a633-03dd19b0c258]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e6a0d-bec5-4605-a244-4b319abc438c]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1732889-7045-4df7-87f3-2705e4a5abf2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[383152ae-37de-4871-aad0-064aba08293c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260]
Nov 16 19:24:43 user nova-compute[86931]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76195417-9735-4859-aee0-7cb006450ed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a27c8-4db9-4166-bc95-6ac199be2a21]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== disconnect_volume: return (371ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrMwQmpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Deleted allocations for instance f36e7459-f870-4c1c-b45f-102a09370f04
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711b3c5-3f9c-4c46-b97c-a4da968700b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: iSNS:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]: STATIC:
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:43 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:43 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:43 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:43 user nova-compute[86931]: No targets found.
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:43 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:43 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b0498-a599-449d-a226-787d3c660ba2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[88da2c5e-0eee-4ecc-a5e7-41d1b2705701]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:43 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c180b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cfaa1cbc-bf86-46d5-94f4-3f0f86987f85 tempest-AttachSCSIVolumeTestJSON-1150846559 tempest-AttachSCSIVolumeTestJSON-1150846559-project-member] Lock "f36e7459-f870-4c1c-b45f-102a09370f04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.912s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d500762-2eb3-4d78-bb29-b90139959b89]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:24:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Creating image(s)
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Ensure instance console log exists: /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start _get_guest_xml network_info=[{"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'def7b9ae-615e-4fba-a3ba-bff5595e7898', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6311dce-9836-41b2-bfc2-c65262aa3012', 'attached_at': '', 'detached_at': '', 'volume_id': '0b692075-47b9-49ff-931a-c612d8ff61a5', 'serial': '0b692075-47b9-49ff-931a-c612d8ff61a5'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ba75e-eb86-42ad-b3af-4d0e276e98d6]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:44 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 19:24:44 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6311dce-9836-41b2-bfc2-c65262aa3012 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c04e7f-de8e-426e-82a9-ec0326a812ab]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:44 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52378300-d951-4837-aac0-0025d45c8730]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5a12a2-b7d3-4eb8-a472-f20614255edb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8505507-c668-4ed9-8a42-98baaf5d6741]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260]
Nov 16 19:24:44 user nova-compute[86931]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b000719d-d10a-4edb-86b4-2bb294fd4a28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[390195e0-acdf-4c52-820f-1330ac0408cb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] <== disconnect_volume: return (316ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Deleting instance files /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf_del
Nov 16 19:24:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Deletion of /opt/stack/data/nova/instances/b35d0170-ff37-4a3d-b748-47778fd4accf_del complete
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.128s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:44 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:44 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a016ab-3ed7-4f10-a115-9d9a16e75cba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:44 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb96a5f-57dc-4416-bab7-f95f8930d7aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5] added
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: INFO nova.compute.manager [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Took 4.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20102f-eb6c-4016-ae69-83823853b19e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff38838e-4fb0-4786-a3ce-484827f40d91]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKCHEJVr {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKCHEJVr" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b421cafe-51c8-498c-9721-f429ff47cdf4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKCHEJVr'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab28a75-156b-4dea-877c-781b8feb0c9e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2735705b-eda2-487c-a744-28b862780471]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e936441c-186b-4055-911d-d0ca9bb32819]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]
Nov 16 19:24:44 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[261fcda1-b8f6-4add-8428-001ada75d443]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca046dd-0e41-4777-9939-262a84a527aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f451ef-02cb-459f-9f4a-48ebb7b0bb3e]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-d6e9058b-3c12-4396-9c4c-616af76c15b5 req-b0cce0b0-1154-4077-af66-7fd3219304ac service nova] [instance: f36e7459-f870-4c1c-b45f-102a09370f04] Received event network-vif-deleted-4b6e21ac-041b-49a7-a569-059d0e03d511 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:44 user nova-compute[86931]: WARNING nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 for instance with vm_state active and task_state deleting.
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-unplugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-unplugged-c8024acd-1d97-429e-b36b-4ab162b2da31 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Acquiring lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] No waiting events found dispatching network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:44 user nova-compute[86931]: WARNING nova.compute.manager [req-87f72e92-4014-4284-8b4e-69587bc327ed req-2b46d8e5-20cf-413b-87e9-553234b2d269 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received unexpected event network-vif-plugged-c8024acd-1d97-429e-b36b-4ab162b2da31 for instance with vm_state active and task_state deleting.
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:45 user nova-compute[86931]: INFO nova.compute.manager [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Detaching volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:45 user nova-compute[86931]: INFO nova.virt.block_device [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Attempting to driver detach volume a1c652c0-45d9-47bd-8108-cf96fd0b9a8c from mountpoint /dev/vdb
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Attempting to detach device vdb from instance b4834f6f-9cdd-450e-bf08-e49d353c3574 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:45 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:45 user nova-compute[86931]:   <source dev="/dev/sdk"/>
Nov 16 19:24:45 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:45 user nova-compute[86931]:   <serial>a1c652c0-45d9-47bd-8108-cf96fd0b9a8c</serial>
Nov 16 19:24:45 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:45 user nova-compute[86931]: </disk>
Nov 16 19:24:45 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Successfully detached device vdb from instance b4834f6f-9cdd-450e-bf08-e49d353c3574 from the persistent domain config.
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4834f6f-9cdd-450e-bf08-e49d353c3574 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:24:45 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:45 user nova-compute[86931]:   <source dev="/dev/sdk"/>
Nov 16 19:24:45 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:24:45 user nova-compute[86931]:   <serial>a1c652c0-45d9-47bd-8108-cf96fd0b9a8c</serial>
Nov 16 19:24:45 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:24:45 user nova-compute[86931]: </disk>
Nov 16 19:24:45 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23261363964636535', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261363964636535', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-488420017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:24:45 user nova-compute[86931]:   <uuid>e6311dce-9836-41b2-bfc2-c65262aa3012</uuid>
Nov 16 19:24:45 user nova-compute[86931]:   <name>instance-00000009</name>
Nov 16 19:24:45 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:24:45 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:24:45 user nova-compute[86931]:   <metadata>
Nov 16 19:24:45 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:24:45 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:24:45 user nova-compute[86931]:       <nova:name>tempest-ServerActionsV293TestJSON-server-488420017</nova:name>
Nov 16 19:24:45 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:24:44</nova:creationTime>
Nov 16 19:24:45 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:24:45 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:24:45 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:24:45 user nova-compute[86931]:       <nova:owner>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:user uuid="d8bd27ea76994ab5937a32f4d1ecc806">tempest-ServerActionsV293TestJSON-649419166-project-member</nova:user>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:project uuid="c2255f38550244b2a37369cd6723f44a">tempest-ServerActionsV293TestJSON-649419166</nova:project>
Nov 16 19:24:45 user nova-compute[86931]:       </nova:owner>
Nov 16 19:24:45 user nova-compute[86931]:       <nova:ports>
Nov 16 19:24:45 user nova-compute[86931]:         <nova:port uuid="8c8f88f6-9aea-4745-ab36-1bae32a5fd44">
Nov 16 19:24:45 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:24:45 user nova-compute[86931]:         </nova:port>
Nov 16 19:24:45 user nova-compute[86931]:       </nova:ports>
Nov 16 19:24:45 user nova-compute[86931]:     </nova:instance>
Nov 16 19:24:45 user nova-compute[86931]:   </metadata>
Nov 16 19:24:45 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:24:45 user nova-compute[86931]:     <system>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="serial">e6311dce-9836-41b2-bfc2-c65262aa3012</entry>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="uuid">e6311dce-9836-41b2-bfc2-c65262aa3012</entry>
Nov 16 19:24:45 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:24:45 user nova-compute[86931]:     </system>
Nov 16 19:24:45 user nova-compute[86931]:   </sysinfo>
Nov 16 19:24:45 user nova-compute[86931]:   <os>
Nov 16 19:24:45 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:24:45 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:24:45 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:24:45 user nova-compute[86931]:   </os>
Nov 16 19:24:45 user nova-compute[86931]:   <features>
Nov 16 19:24:45 user nova-compute[86931]:     <acpi/>
Nov 16 19:24:45 user nova-compute[86931]:     <apic/>
Nov 16 19:24:45 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:24:45 user nova-compute[86931]:   </features>
Nov 16 19:24:45 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:24:45 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:24:45 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:24:45 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:24:45 user nova-compute[86931]:   </clock>
Nov 16 19:24:45 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:24:45 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:24:45 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:24:45 user nova-compute[86931]:   </cpu>
Nov 16 19:24:45 user nova-compute[86931]:   <devices>
Nov 16 19:24:45 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:24:45 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:24:45 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:24:45 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:24:45 user nova-compute[86931]:       <serial>0b692075-47b9-49ff-931a-c612d8ff61a5</serial>
Nov 16 19:24:45 user nova-compute[86931]:     </disk>
Nov 16 19:24:45 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:24:45 user nova-compute[86931]:       <mac address="fa:16:3e:29:ff:97"/>
Nov 16 19:24:45 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:24:45 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:24:45 user nova-compute[86931]:       <target dev="tap8c8f88f6-9a"/>
Nov 16 19:24:45 user nova-compute[86931]:     </interface>
Nov 16 19:24:45 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:24:45 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012/console.log" append="off"/>
Nov 16 19:24:45 user nova-compute[86931]:     </serial>
Nov 16 19:24:45 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:24:45 user nova-compute[86931]:     <video>
Nov 16 19:24:45 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:24:45 user nova-compute[86931]:     </video>
Nov 16 19:24:45 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:24:45 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:24:45 user nova-compute[86931]:     </rng>
Nov 16 19:24:45 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:24:45 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:24:45 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:24:45 user nova-compute[86931]:     </memballoon>
Nov 16 19:24:45 user nova-compute[86931]:   </devices>
Nov 16 19:24:45 user nova-compute[86931]: </domain>
Nov 16 19:24:45 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-488420017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG os_vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a26c133-ccca-5fb9-8ebd-9e8b51b92229', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8f88f6-9a, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8f88f6-9a, col_values=(('qos', UUID('a567b20e-1a05-4c78-81ad-2aaa2530ff81')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8f88f6-9a, col_values=(('external_ids', {'iface-id': '8c8f88f6-9aea-4745-ab36-1bae32a5fd44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:ff:97', 'vm-uuid': 'e6311dce-9836-41b2-bfc2-c65262aa3012'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:45 user nova-compute[86931]: INFO os_vif [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a')
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] No VIF found with MAC fa:16:3e:29:ff:97, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.compute.claims [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Claim successful on node user
Nov 16 19:24:46 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7269c7b0-d837-4201-8695-83eeb7c7824f is timed out.
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully detached device vdb from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the live domain config.
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqgXzvDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:46 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[347614b1-6889-429c-b48c-e7c27e03891b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:46 user nova-compute[86931]: No targets found.
Nov 16 19:24:46 user nova-compute[86931]: iSNS:
Nov 16 19:24:46 user nova-compute[86931]: No targets found.
Nov 16 19:24:46 user nova-compute[86931]: STATIC:
Nov 16 19:24:46 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:46 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:46 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:46 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:24:46 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:46 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:46 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:46 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:46 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:46 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077
Nov 16 19:24:46 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:46 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:46 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:46 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:46 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:46 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:46 user nova-compute[86931]: No targets found.
Nov 16 19:24:46 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:46 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:46 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef0213-19c2-4c4a-872c-652987019aac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d27b6f-d2a6-4e3f-9177-df9c4efd1be4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:46 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c230040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d278df-9020-49de-a919-37bfa0b3465c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-deleted-c8024acd-1d97-429e-b36b-4ab162b2da31 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Neutron deleted interface c8024acd-1d97-429e-b36b-4ab162b2da31; detaching it from the instance and deleting it from the info cache
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.network.neutron [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "address": "fa:16:3e:eb:e3:a6", "network": {"id": "477b05a2-6963-47f9-a121-684d2569d411", "bridge": "br-int", "label": "tempest-device-tagging-net2-2088893188", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1121d492-f3", "ovs_interfaceid": "1121d492-f35c-4c80-84c0-ca6fd568bcc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de7644f-7d3b-4c6f-9bc3-767f38af9079]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e9bc9-8e89-4a74-9a56-ea3b8024df63]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Detach interface failed, port_id=c8024acd-1d97-429e-b36b-4ab162b2da31, reason: Instance b35d0170-ff37-4a3d-b748-47778fd4accf could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-deleted-1121d492-f35c-4c80-84c0-ca6fd568bcc9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Neutron deleted interface 1121d492-f35c-4c80-84c0-ca6fd568bcc9; detaching it from the instance and deleting it from the info cache
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.network.neutron [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "426031cc-fe4e-471f-ba51-af89f3b4e011", "address": "fa:16:3e:68:e9:a2", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426031cc-fe", "ovs_interfaceid": "426031cc-fe4e-471f-ba51-af89f3b4e011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Detach interface failed, port_id=1121d492-f35c-4c80-84c0-ca6fd568bcc9, reason: Instance b35d0170-ff37-4a3d-b748-47778fd4accf could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-deleted-426031cc-fe4e-471f-ba51-af89f3b4e011 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Neutron deleted interface 426031cc-fe4e-471f-ba51-af89f3b4e011; detaching it from the instance and deleting it from the info cache
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.network.neutron [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [{"id": "38c945f9-d08b-4088-90f5-82ed86eb9472", "address": "fa:16:3e:0d:b8:8a", "network": {"id": "cbb677ab-7132-4b05-9d8a-9d18a854adce", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1297762121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38c945f9-d0", "ovs_interfaceid": "38c945f9-d08b-4088-90f5-82ed86eb9472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "address": "fa:16:3e:35:83:15", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4b8cb5a-7e", "ovs_interfaceid": "e4b8cb5a-7eb3-43aa-8945-fc14827af191", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "address": "fa:16:3e:bc:c0:55", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66133fec-c9", "ovs_interfaceid": "66133fec-c906-4f0a-8c2f-41b27c30e4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "address": "fa:16:3e:41:a7:07", "network": {"id": "c111fa1e-aeb1-4d73-8f56-4706d1fa0841", "bridge": "br-int", "label": "tempest-device-tagging-net1-79181245", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7e66d5d6b5dc4d99901e64aa6b9562f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8918dd-1a", "ovs_interfaceid": "2f8918dd-1a9f-45f8-9c74-1b33ea5901c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.072s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f202b7a-7502-488d-abd0-9428fe346960]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-aba797ff-8cec-4760-899c-869604f3f662 req-02f3c56b-d217-4023-8ed6-eedd6355c3b0 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Detach interface failed, port_id=426031cc-fe4e-471f-ba51-af89f3b4e011, reason: Instance b35d0170-ff37-4a3d-b748-47778fd4accf could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dfc3fb-0550-457e-aa3d-f24d7162dc1c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb1bde-aaed-44a8-ae69-2ff8bd6d3463]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260]
Nov 16 19:24:46 user nova-compute[86931]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:46 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ddd5aec-267d-4cba-81de-3858ad3c1077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d183d-7523-4907-aef0-f6b079add65f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] <== disconnect_volume: return (371ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:24:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:24:46 user nova-compute[86931]: INFO nova.virt.block_device [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Booting with blank volume at /dev/vda
Nov 16 19:24:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG nova.policy [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c8c15e0597f411f81270cd3b181043b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97456514d9f541ec936e509c558e60db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d4bcc175-f907-46dd-b6cf-04715cd265b5 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.125s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 782a1af8-63f6-4630-b5e2-5819e75c1673 is timed out.
Nov 16 19:24:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Successfully detached device vdb from instance 782a1af8-63f6-4630-b5e2-5819e75c1673 from the live domain config.
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bPBLsRTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbdaace-ceee-44f2-869f-28d8d973a79a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:24:48 user nova-compute[86931]: No targets found.
Nov 16 19:24:48 user nova-compute[86931]: iSNS:
Nov 16 19:24:48 user nova-compute[86931]: No targets found.
Nov 16 19:24:48 user nova-compute[86931]: STATIC:
Nov 16 19:24:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:24:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:24:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:24:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369
Nov 16 19:24:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:24:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:24:48 user nova-compute[86931]: FIRMWARE:
Nov 16 19:24:48 user nova-compute[86931]: No targets found.
Nov 16 19:24:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:24:48 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:24:48 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3026ce42-8dc9-4faf-8e2f-c5f048e9dd1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa295dc-c02c-473d-9ca6-b49b95e80c1b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c285360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369'): ({'sdg'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Removing single pathed devices sdg {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd3f6c1-6025-4ed0-8eb6-6d9000a29e3a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87f972-6bb1-43d2-9b7c-7c9481d7a020]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Flushing IO for device /dev/sdg {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6647d3-21d1-4f2d-a6c9-8e5d38b4e380]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Successfully created port: e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6df05d-d351-4989-adaa-32418d45052e]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Took 4.31 seconds to deallocate network for instance.
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2237bb2-7942-4bbe-8564-53aca1448825]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a2493-d68a-4c47-8ea5-8f37f4ec68e8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260]
Nov 16 19:24:48 user nova-compute[86931]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:48 user nova-compute[86931]: WARNING nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-deleted-38c945f9-d08b-4088-90f5-82ed86eb9472 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:48 user nova-compute[86931]: WARNING nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-d0a0103f-5d4e-47d7-8548-2a0a03427904 req-e1eb17b7-bbbf-4442-ab05-ca09842b6255 service nova] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Received event network-vif-deleted-2f8918dd-1a9f-45f8-9c74-1b33ea5901c3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3774656-d32d-4f03-af75-c664b337e369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7512ac8-fe2c-4382-bf7e-71bf3291960e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] <== disconnect_volume: return (347ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-79db1954-0b19-4cf0-9761-25ff2c342044" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-79db1954-0b19-4cf0-9761-25ff2c342044" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Attempting to detach device tap79db1954-0b from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] detach device xml: <interface type="ethernet">
Nov 16 19:24:49 user nova-compute[86931]:   <mac address="fa:16:3e:c9:9b:10"/>
Nov 16 19:24:49 user nova-compute[86931]:   <model type="virtio"/>
Nov 16 19:24:49 user nova-compute[86931]:   <mtu size="1442"/>
Nov 16 19:24:49 user nova-compute[86931]:   <target dev="tap79db1954-0b"/>
Nov 16 19:24:49 user nova-compute[86931]: </interface>
Nov 16 19:24:49 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 19:24:49 user nova-compute[86931]:   <name>instance-00000008</name>
Nov 16 19:24:49 user nova-compute[86931]:   <uuid>7269c7b0-d837-4201-8695-83eeb7c7824f</uuid>
Nov 16 19:24:49 user nova-compute[86931]:   <metadata>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:24:49 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:24:14</nova:creationTime>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:24:49 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:24:49 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:owner>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:24:49 user nova-compute[86931]:   </nova:owner>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:24:49 user nova-compute[86931]:   <nova:ports>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:24:49 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:24:49 user nova-compute[86931]:     </nova:port>
Nov 16 19:24:49 user nova-compute[86931]:     <nova:port uuid="79db1954-0b19-4cf0-9761-25ff2c342044">
Nov 16 19:24:49 user nova-compute[86931]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Nov 16 19:24:49 user nova-compute[86931]:     </nova:port>
Nov 16 19:24:49 user nova-compute[86931]:   </nova:ports>
Nov 16 19:24:49 user nova-compute[86931]: </nova:instance>
Nov 16 19:24:49 user nova-compute[86931]:   </metadata>
Nov 16 19:24:49 user nova-compute[86931]:   <memory unit='KiB'>524288</memory>
Nov 16 19:24:49 user nova-compute[86931]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 19:24:49 user nova-compute[86931]:   <vcpu placement='static'>1</vcpu>
Nov 16 19:24:49 user nova-compute[86931]:   <resource>
Nov 16 19:24:49 user nova-compute[86931]:     <partition>/machine</partition>
Nov 16 19:24:49 user nova-compute[86931]:   </resource>
Nov 16 19:24:49 user nova-compute[86931]:   <sysinfo type='smbios'>
Nov 16 19:24:49 user nova-compute[86931]:     <system>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='version'>0.0.0</entry>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='serial'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='uuid'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:24:49 user nova-compute[86931]:       <entry name='family'>Virtual Machine</entry>
Nov 16 19:24:49 user nova-compute[86931]:     </system>
Nov 16 19:24:49 user nova-compute[86931]:   </sysinfo>
Nov 16 19:24:49 user nova-compute[86931]:   <os>
Nov 16 19:24:49 user nova-compute[86931]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 19:24:49 user nova-compute[86931]:     <boot dev='hd'/>
Nov 16 19:24:49 user nova-compute[86931]:     <smbios mode='sysinfo'/>
Nov 16 19:24:49 user nova-compute[86931]:   </os>
Nov 16 19:24:49 user nova-compute[86931]:   <features>
Nov 16 19:24:49 user nova-compute[86931]:     <acpi/>
Nov 16 19:24:49 user nova-compute[86931]:     <apic/>
Nov 16 19:24:49 user nova-compute[86931]:     <vmcoreinfo state='on'/>
Nov 16 19:24:49 user nova-compute[86931]:   </features>
Nov 16 19:24:49 user nova-compute[86931]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 19:24:49 user nova-compute[86931]:     <model fallback='forbid'>Nehalem</model>
Nov 16 19:24:49 user nova-compute[86931]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 19:24:49 user nova-compute[86931]:     <feature policy='require' name='vme'/>
Nov 16 19:24:49 user nova-compute[86931]:     <feature policy='require' name='x2apic'/>
Nov 16 19:24:49 user nova-compute[86931]:     <feature policy='require' name='hypervisor'/>
Nov 16 19:24:49 user nova-compute[86931]:   </cpu>
Nov 16 19:24:49 user nova-compute[86931]:   <clock offset='utc'>
Nov 16 19:24:49 user nova-compute[86931]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 19:24:49 user nova-compute[86931]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 19:24:49 user nova-compute[86931]:     <timer name='hpet' present='no'/>
Nov 16 19:24:49 user nova-compute[86931]:   </clock>
Nov 16 19:24:49 user nova-compute[86931]:   <on_poweroff>destroy</on_poweroff>
Nov 16 19:24:49 user nova-compute[86931]:   <on_reboot>restart</on_reboot>
Nov 16 19:24:49 user nova-compute[86931]:   <on_crash>destroy</on_crash>
Nov 16 19:24:49 user nova-compute[86931]:   <devices>
Nov 16 19:24:49 user nova-compute[86931]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 19:24:49 user nova-compute[86931]:     <disk type='file' device='disk'>
Nov 16 19:24:49 user nova-compute[86931]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 19:24:49 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk' index='2'/>
Nov 16 19:24:49 user nova-compute[86931]:       <backingStore type='file' index='3'>
Nov 16 19:24:49 user nova-compute[86931]:         <format type='raw'/>
Nov 16 19:24:49 user nova-compute[86931]:         <source file='/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93'/>
Nov 16 19:24:49 user nova-compute[86931]:         <backingStore/>
Nov 16 19:24:49 user nova-compute[86931]:       </backingStore>
Nov 16 19:24:49 user nova-compute[86931]:       <target dev='vda' bus='virtio'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='virtio-disk0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </disk>
Nov 16 19:24:49 user nova-compute[86931]:     <disk type='file' device='cdrom'>
Nov 16 19:24:49 user nova-compute[86931]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 19:24:49 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config' index='1'/>
Nov 16 19:24:49 user nova-compute[86931]:       <backingStore/>
Nov 16 19:24:49 user nova-compute[86931]:       <target dev='hda' bus='ide'/>
Nov 16 19:24:49 user nova-compute[86931]:       <readonly/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='ide0-0-0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </disk>
Nov 16 19:24:49 user nova-compute[86931]:     <controller type='usb' index='0' model='none'>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='usb'/>
Nov 16 19:24:49 user nova-compute[86931]:     </controller>
Nov 16 19:24:49 user nova-compute[86931]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='pci.0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </controller>
Nov 16 19:24:49 user nova-compute[86931]:     <controller type='ide' index='0'>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='ide'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 19:24:49 user nova-compute[86931]:     </controller>
Nov 16 19:24:49 user nova-compute[86931]:     <interface type='ethernet'>
Nov 16 19:24:49 user nova-compute[86931]:       <mac address='fa:16:3e:47:4f:09'/>
Nov 16 19:24:49 user nova-compute[86931]:       <target dev='tap83c9ef40-99'/>
Nov 16 19:24:49 user nova-compute[86931]:       <model type='virtio'/>
Nov 16 19:24:49 user nova-compute[86931]:       <mtu size='1442'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='net0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </interface>
Nov 16 19:24:49 user nova-compute[86931]:     <interface type='ethernet'>
Nov 16 19:24:49 user nova-compute[86931]:       <mac address='fa:16:3e:c9:9b:10'/>
Nov 16 19:24:49 user nova-compute[86931]:       <target dev='tap79db1954-0b'/>
Nov 16 19:24:49 user nova-compute[86931]:       <model type='virtio'/>
Nov 16 19:24:49 user nova-compute[86931]:       <mtu size='1442'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='net1'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </interface>
Nov 16 19:24:49 user nova-compute[86931]:     <serial type='pty'>
Nov 16 19:24:49 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:24:49 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:24:49 user nova-compute[86931]:       <target type='isa-serial' port='0'>
Nov 16 19:24:49 user nova-compute[86931]:         <model name='isa-serial'/>
Nov 16 19:24:49 user nova-compute[86931]:       </target>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </serial>
Nov 16 19:24:49 user nova-compute[86931]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 19:24:49 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:24:49 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:24:49 user nova-compute[86931]:       <target type='serial' port='0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </console>
Nov 16 19:24:49 user nova-compute[86931]:     <input type='mouse' bus='ps2'>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='input0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </input>
Nov 16 19:24:49 user nova-compute[86931]:     <input type='keyboard' bus='ps2'>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='input1'/>
Nov 16 19:24:49 user nova-compute[86931]:     </input>
Nov 16 19:24:49 user nova-compute[86931]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 19:24:49 user nova-compute[86931]:       <listen type='address' address='0.0.0.0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </graphics>
Nov 16 19:24:49 user nova-compute[86931]:     <audio id='1' type='none'/>
Nov 16 19:24:49 user nova-compute[86931]:     <video>
Nov 16 19:24:49 user nova-compute[86931]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='video0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </video>
Nov 16 19:24:49 user nova-compute[86931]:     <memballoon model='virtio'>
Nov 16 19:24:49 user nova-compute[86931]:       <stats period='10'/>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='balloon0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </memballoon>
Nov 16 19:24:49 user nova-compute[86931]:     <rng model='virtio'>
Nov 16 19:24:49 user nova-compute[86931]:       <backend model='random'>/dev/urandom</backend>
Nov 16 19:24:49 user nova-compute[86931]:       <alias name='rng0'/>
Nov 16 19:24:49 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 19:24:49 user nova-compute[86931]:     </rng>
Nov 16 19:24:49 user nova-compute[86931]:   </devices>
Nov 16 19:24:49 user nova-compute[86931]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 19:24:49 user nova-compute[86931]:     <label>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</label>
Nov 16 19:24:49 user nova-compute[86931]:     <imagelabel>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</imagelabel>
Nov 16 19:24:49 user nova-compute[86931]:   </seclabel>
Nov 16 19:24:49 user nova-compute[86931]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 19:24:49 user nova-compute[86931]:     <label>+64055:+108</label>
Nov 16 19:24:49 user nova-compute[86931]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 19:24:49 user nova-compute[86931]:   </seclabel>
Nov 16 19:24:49 user nova-compute[86931]: </domain>
Nov 16 19:24:49 user nova-compute[86931]:  {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 19:24:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully detached device tap79db1954-0b from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the persistent domain config.
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] (1/8): Attempting to detach device tap79db1954-0b with device alias net1 from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] detach device xml: <interface type="ethernet">
Nov 16 19:24:49 user nova-compute[86931]:   <mac address="fa:16:3e:c9:9b:10"/>
Nov 16 19:24:49 user nova-compute[86931]:   <model type="virtio"/>
Nov 16 19:24:49 user nova-compute[86931]:   <mtu size="1442"/>
Nov 16 19:24:49 user nova-compute[86931]:   <target dev="tap79db1954-0b"/>
Nov 16 19:24:49 user nova-compute[86931]: </interface>
Nov 16 19:24:49 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Successfully updated port: e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:24:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance spawned successfully.
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Start waiting for the detach event from libvirt for device tap79db1954-0b with device alias net1 for instance 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-unplugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-unplugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:49 user nova-compute[86931]: WARNING nova.compute.manager [req-af033599-cd9e-49df-8c7f-6199e8dcb2d2 req-ddb0798f-12e3-4e0d-8a54-6602e09d5925 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-unplugged-79db1954-0b19-4cf0-9761-25ff2c342044 for instance with vm_state active and task_state None.
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Trying to apply a migration context that does not seem to be set for this instance {{(pid=86931) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance network_info: |[{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:24:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7a01cbb1-2ef9-45ff-adc1-b5c1cebc88dd tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.140s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-changed-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Refreshing instance network info cache due to event network-changed-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Refreshing network info cache for port e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updated VIF entry in instance network info cache for port e07d532f-681d-4ea2-b9b3-88bc2e3acbeb. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-053817ae-8805-4848-b3d6-0d34e4241473 req-6493ab31-398b-4cd9-98d2-83f63669fe44 service nova] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:51 user nova-compute[86931]: WARNING nova.compute.manager [req-2905ee3a-3be1-43a8-8da7-94e73e717254 req-fe9fccfb-1a09-4f4d-a214-7d52cdbbbe2f service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-79db1954-0b19-4cf0-9761-25ff2c342044 for instance with vm_state active and task_state None.
Nov 16 19:24:52 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lazy-loading 'flavor' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f16a9429-b2e6-4e3d-b98d-f9fcdff3a440 tempest-VolumesAssistedSnapshotsTest-108309100 tempest-VolumesAssistedSnapshotsTest-108309100-project-admin] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.573s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.utils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba04f31-9453-4d81-aef0-34c1a66ff6fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[63596ee7-8e7f-405f-84df-a897e8d0b382]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d6f6e-f0c4-4d77-85ba-e642a58ff9d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7038c4f6-f556-40a4-a74b-0d718cf5d723]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:24:52 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:24:52 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2a14f-db47-481a-8684-56ae22890ffe]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG os_brick.utils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:24:52 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating existing volume attachment record: 7fd4ca2a-b9c6-4b64-aa80-70dc8dde0aaf {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "fda35273-3799-4e6c-9170-4cc8779d9b37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:24:54 user nova-compute[86931]: INFO nova.compute.claims [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Claim successful on node user
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:24:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:24:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.policy [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '314dbeab5ae5441a813eebc5e6e24c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bf618b6c25f4e89b89d837f91df2063', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:24:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Creating image(s)
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "/opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "/opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "/opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk 1073741824" returned: 0 in 0.051s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Successfully created port: a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Cannot resize image /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Ensure instance console log exists: /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Successfully updated port: a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquired lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received event network-changed-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Refreshing instance network info cache due to event network-changed-a171861c-b367-45f0-927d-6c7ca68c0e44. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] Acquiring lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Updating instance_info_cache with network_info: [{"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Releasing lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Instance network_info: |[{"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] Acquired lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Refreshing network info cache for port a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Start _get_guest_xml network_info=[{"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:24:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1732015906',display_name='tempest-VolumesAdminNegativeTest-server-1732015906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1732015906',id=13,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-hquol1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:55Z,user_data=None,user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=fda35273-3799-4e6c-9170-4cc8779d9b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'pci_devices' on Instance uuid fda35273-3799-4e6c-9170-4cc8779d9b37 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:24:56 user nova-compute[86931]:   <uuid>fda35273-3799-4e6c-9170-4cc8779d9b37</uuid>
Nov 16 19:24:56 user nova-compute[86931]:   <name>instance-0000000d</name>
Nov 16 19:24:56 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:24:56 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:24:56 user nova-compute[86931]:   <metadata>
Nov 16 19:24:56 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:24:56 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1732015906</nova:name>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:24:56</nova:creationTime>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:24:56 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:24:56 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:owner>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:user uuid="314dbeab5ae5441a813eebc5e6e24c98">tempest-VolumesAdminNegativeTest-1956727884-project-member</nova:user>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:project uuid="5bf618b6c25f4e89b89d837f91df2063">tempest-VolumesAdminNegativeTest-1956727884</nova:project>
Nov 16 19:24:56 user nova-compute[86931]:       </nova:owner>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:24:56 user nova-compute[86931]:       <nova:ports>
Nov 16 19:24:56 user nova-compute[86931]:         <nova:port uuid="a171861c-b367-45f0-927d-6c7ca68c0e44">
Nov 16 19:24:56 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:24:56 user nova-compute[86931]:         </nova:port>
Nov 16 19:24:56 user nova-compute[86931]:       </nova:ports>
Nov 16 19:24:56 user nova-compute[86931]:     </nova:instance>
Nov 16 19:24:56 user nova-compute[86931]:   </metadata>
Nov 16 19:24:56 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:24:56 user nova-compute[86931]:     <system>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="serial">fda35273-3799-4e6c-9170-4cc8779d9b37</entry>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="uuid">fda35273-3799-4e6c-9170-4cc8779d9b37</entry>
Nov 16 19:24:56 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:24:56 user nova-compute[86931]:     </system>
Nov 16 19:24:56 user nova-compute[86931]:   </sysinfo>
Nov 16 19:24:56 user nova-compute[86931]:   <os>
Nov 16 19:24:56 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:24:56 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:24:56 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:24:56 user nova-compute[86931]:   </os>
Nov 16 19:24:56 user nova-compute[86931]:   <features>
Nov 16 19:24:56 user nova-compute[86931]:     <acpi/>
Nov 16 19:24:56 user nova-compute[86931]:     <apic/>
Nov 16 19:24:56 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:24:56 user nova-compute[86931]:   </features>
Nov 16 19:24:56 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:24:56 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:24:56 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:24:56 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:24:56 user nova-compute[86931]:   </clock>
Nov 16 19:24:56 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:24:56 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:24:56 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:24:56 user nova-compute[86931]:   </cpu>
Nov 16 19:24:56 user nova-compute[86931]:   <devices>
Nov 16 19:24:56 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:24:56 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:24:56 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk"/>
Nov 16 19:24:56 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:24:56 user nova-compute[86931]:     </disk>
Nov 16 19:24:56 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:24:56 user nova-compute[86931]:       <mac address="fa:16:3e:58:05:c6"/>
Nov 16 19:24:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:24:56 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:24:56 user nova-compute[86931]:       <target dev="tapa171861c-b3"/>
Nov 16 19:24:56 user nova-compute[86931]:     </interface>
Nov 16 19:24:56 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:24:56 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/console.log" append="off"/>
Nov 16 19:24:56 user nova-compute[86931]:     </serial>
Nov 16 19:24:56 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:24:56 user nova-compute[86931]:     <video>
Nov 16 19:24:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:24:56 user nova-compute[86931]:     </video>
Nov 16 19:24:56 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:24:56 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:24:56 user nova-compute[86931]:     </rng>
Nov 16 19:24:56 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:24:56 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:24:56 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:24:56 user nova-compute[86931]:     </memballoon>
Nov 16 19:24:56 user nova-compute[86931]:   </devices>
Nov 16 19:24:56 user nova-compute[86931]: </domain>
Nov 16 19:24:56 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1732015906',display_name='tempest-VolumesAdminNegativeTest-server-1732015906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1732015906',id=13,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-hquol1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:55Z,user_data=None,user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=fda35273-3799-4e6c-9170-4cc8779d9b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG os_vif [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71e54675-f01e-5497-ac9d-1a7f2a7dde59', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa171861c-b3, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa171861c-b3, col_values=(('qos', UUID('6624010b-51a0-4f42-a694-eab2fe462aec')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa171861c-b3, col_values=(('external_ids', {'iface-id': 'a171861c-b367-45f0-927d-6c7ca68c0e44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:05:c6', 'vm-uuid': 'fda35273-3799-4e6c-9170-4cc8779d9b37'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:24:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:57 user nova-compute[86931]: INFO os_vif [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3')
Nov 16 19:24:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] No VIF found with MAC fa:16:3e:58:05:c6, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Updated VIF entry in instance network info cache for port a171861c-b367-45f0-927d-6c7ca68c0e44. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Updating instance_info_cache with network_info: [{"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:24:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-664d6b7e-fa2b-4117-a2ac-5487ee491f9e req-e0d2ae05-e8d9-4d52-89b4-a56e15d78038 service nova] Releasing lock "refresh_cache-fda35273-3799-4e6c-9170-4cc8779d9b37" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:58 user nova-compute[86931]: INFO nova.compute.manager [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] [instance: b35d0170-ff37-4a3d-b748-47778fd4accf] Took 10.03 seconds to detach 3 volumes for instance.
Nov 16 19:24:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received event network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] Acquiring lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] No waiting events found dispatching network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:24:58 user nova-compute[86931]: WARNING nova.compute.manager [req-4ff219a6-ac14-44d5-9683-4631b7c0c9bd req-89b6d1e1-d931-40d0-9de6-27dc550cc81b service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received unexpected event network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 for instance with vm_state building and task_state spawning.
Nov 16 19:24:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:24:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Creating image(s)
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Ensure instance console log exists: /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start _get_guest_xml network_info=[{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '7fd4ca2a-b9c6-4b64-aa80-70dc8dde0aaf', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04ec3edd-f329-47d3-84df-85343c9b4336', 'attached_at': '', 'detached_at': '', 'volume_id': '58534ea8-5a28-42c9-ac38-8616c8402051', 'serial': '58534ea8-5a28-42c9-ac38-8616c8402051'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:24:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:24:59 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:24:59 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Deleted allocations for instance b35d0170-ff37-4a3d-b748-47778fd4accf
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f58e8-3f8c-4056-abb0-10f7b38ec852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:24:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[81478f5c-b8b2-4737-aca0-b7edb683028f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051] added
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f369a-a1f1-4d1b-a68b-b56044ec93bb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d82a90-fa5f-44f8-89a1-74e450d7e0f0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzyOTjYq {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbe67bd-91a2-48b7-8f6a-e6bf590eee8e tempest-TaggedBootDevicesTest_v242-2112492756 tempest-TaggedBootDevicesTest_v242-2112492756-project-member] Lock "b35d0170-ff37-4a3d-b748-47778fd4accf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.950s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzyOTjYq" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5c6145-24a3-4afd-95aa-b5e0c60b29d8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzyOTjYq'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64ad02-a4d1-4f0c-9ea5-f8ec3b7d64d5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af91c33-c0e6-4fcc-8884-4cec1f0a183f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445d737-1f52-4213-92ed-fe9d0f92cb5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260]
Nov 16 19:24:59 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260] successful.
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0cdd71-084e-4979-87fc-5ba1e64d7386]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8f5593-6540-4f19-ab2f-bf51c7810937]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:24:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed8b0a-d1a8-4e16-b98b-dd6c40ac2276]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:24:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26237373766316338', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237373766316338', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-39047473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-39047473',id=12,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-j1i0hpw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:47Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=04ec3edd-f329-47d3-84df-85343c9b4336,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.objects.instance [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:25:00 user nova-compute[86931]:   <uuid>04ec3edd-f329-47d3-84df-85343c9b4336</uuid>
Nov 16 19:25:00 user nova-compute[86931]:   <name>instance-0000000c</name>
Nov 16 19:25:00 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:25:00 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:25:00 user nova-compute[86931]:   <metadata>
Nov 16 19:25:00 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:00 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-39047473</nova:name>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:24:59</nova:creationTime>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:25:00 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:00 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:owner>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:25:00 user nova-compute[86931]:       </nova:owner>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:00 user nova-compute[86931]:       <nova:ports>
Nov 16 19:25:00 user nova-compute[86931]:         <nova:port uuid="e07d532f-681d-4ea2-b9b3-88bc2e3acbeb">
Nov 16 19:25:00 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:25:00 user nova-compute[86931]:         </nova:port>
Nov 16 19:25:00 user nova-compute[86931]:       </nova:ports>
Nov 16 19:25:00 user nova-compute[86931]:     </nova:instance>
Nov 16 19:25:00 user nova-compute[86931]:   </metadata>
Nov 16 19:25:00 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:25:00 user nova-compute[86931]:     <system>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="serial">04ec3edd-f329-47d3-84df-85343c9b4336</entry>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="uuid">04ec3edd-f329-47d3-84df-85343c9b4336</entry>
Nov 16 19:25:00 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:25:00 user nova-compute[86931]:     </system>
Nov 16 19:25:00 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:00 user nova-compute[86931]:   <os>
Nov 16 19:25:00 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:25:00 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:25:00 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:25:00 user nova-compute[86931]:   </os>
Nov 16 19:25:00 user nova-compute[86931]:   <features>
Nov 16 19:25:00 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:00 user nova-compute[86931]:     <apic/>
Nov 16 19:25:00 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:25:00 user nova-compute[86931]:   </features>
Nov 16 19:25:00 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:25:00 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:25:00 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:25:00 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:25:00 user nova-compute[86931]:   </clock>
Nov 16 19:25:00 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:25:00 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:25:00 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:25:00 user nova-compute[86931]:   </cpu>
Nov 16 19:25:00 user nova-compute[86931]:   <devices>
Nov 16 19:25:00 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:25:00 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:25:00 user nova-compute[86931]:       <source dev="/dev/sdb"/>
Nov 16 19:25:00 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:25:00 user nova-compute[86931]:       <serial>58534ea8-5a28-42c9-ac38-8616c8402051</serial>
Nov 16 19:25:00 user nova-compute[86931]:     </disk>
Nov 16 19:25:00 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:25:00 user nova-compute[86931]:       <mac address="fa:16:3e:7f:a2:09"/>
Nov 16 19:25:00 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:00 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:25:00 user nova-compute[86931]:       <target dev="tape07d532f-68"/>
Nov 16 19:25:00 user nova-compute[86931]:     </interface>
Nov 16 19:25:00 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:25:00 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/console.log" append="off"/>
Nov 16 19:25:00 user nova-compute[86931]:     </serial>
Nov 16 19:25:00 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:25:00 user nova-compute[86931]:     <video>
Nov 16 19:25:00 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:00 user nova-compute[86931]:     </video>
Nov 16 19:25:00 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:25:00 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:25:00 user nova-compute[86931]:     </rng>
Nov 16 19:25:00 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:25:00 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:25:00 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:25:00 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:00 user nova-compute[86931]:   </devices>
Nov 16 19:25:00 user nova-compute[86931]: </domain>
Nov 16 19:25:00 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-39047473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-39047473',id=12,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-j1i0hpw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:24:47Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=04ec3edd-f329-47d3-84df-85343c9b4336,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG os_vif [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '012da3b7-828a-51cb-8e25-f62534fe32f2', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape07d532f-68, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape07d532f-68, col_values=(('qos', UUID('bd6ff4fc-a19d-436e-9679-915c2877cef1')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape07d532f-68, col_values=(('external_ids', {'iface-id': 'e07d532f-681d-4ea2-b9b3-88bc2e3acbeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a2:09', 'vm-uuid': '04ec3edd-f329-47d3-84df-85343c9b4336'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:00 user nova-compute[86931]: INFO os_vif [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68')
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:7f:a2:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received event network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] Acquiring lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] No waiting events found dispatching network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:00 user nova-compute[86931]: WARNING nova.compute.manager [req-4a28adac-d91a-4135-b24e-1f37a76469f3 req-bc9bc19b-969b-4a24-84eb-6e2d9f6f0d5a service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received unexpected event network-vif-plugged-a171861c-b367-45f0-927d-6c7ca68c0e44 for instance with vm_state building and task_state spawning.
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:25:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Instance spawned successfully.
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:00 user nova-compute[86931]: INFO nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 16 19:25:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:25:01 user nova-compute[86931]: INFO nova.compute.manager [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Took 6.74 seconds to build instance.
Nov 16 19:25:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-42524502-e922-49c7-9056-9335f29da22d tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.839s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:02 user nova-compute[86931]: WARNING nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state building and task_state spawning.
Nov 16 19:25:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:02 user nova-compute[86931]: WARNING nova.compute.manager [req-75af241c-4aa7-4e25-8d07-d95aa9860bb3 req-2456de40-f48d-431c-a4b3-915015788b0b service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state building and task_state spawning.
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:25:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance spawned successfully.
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:04 user nova-compute[86931]: INFO nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 16 19:25:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:25:04 user nova-compute[86931]: INFO nova.compute.manager [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Took 18.45 seconds to build instance.
Nov 16 19:25:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-014ed1ee-09bf-48fd-ba49-161f85374189 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.559s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:05 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b4834f6f-9cdd-450e-bf08-e49d353c3574 is timed out.
Nov 16 19:25:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Successfully detached device vdb from instance b4834f6f-9cdd-450e-bf08-e49d353c3574 from the live domain config.
Nov 16 19:25:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrcenduY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'a1c652c0-45d9-47bd-8108-cf96fd0b9a8c'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:25:05 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ffbde6-c231-4887-9f8a-161573902845]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:25:05 user nova-compute[86931]: No targets found.
Nov 16 19:25:05 user nova-compute[86931]: iSNS:
Nov 16 19:25:05 user nova-compute[86931]: No targets found.
Nov 16 19:25:05 user nova-compute[86931]: STATIC:
Nov 16 19:25:05 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c
Nov 16 19:25:05 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:05 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:05 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:25:05 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:05 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:05 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:25:05 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:05 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:05 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:25:05 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:05 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:05 user nova-compute[86931]: FIRMWARE:
Nov 16 19:25:05 user nova-compute[86931]: No targets found.
Nov 16 19:25:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:25:05 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:25:05 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8ce4f-4b45-4ea1-8fea-f124c06a2a44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b2bebe-9aee-4eb0-97bc-a24475470471]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c603640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c'): ({'sdk'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Removing single pathed devices sdk {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5bda71-1dd8-4f01-a7ac-affe0aa27e12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abc8ca7-6ba5-458a-9d79-ba5b766cfd1f]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Flushing IO for device /dev/sdk {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9c9db-b864-4951-a312-501ed082c8ba]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:25:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.086s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef763071-b604-4b1c-a553-00a797a8180c]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] SCSI volumes sdk have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f5096-cf6c-49a8-8780-428be785e12a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b77db2-e03f-4fd0-87fd-01462e9f9ce6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260]
Nov 16 19:25:06 user nova-compute[86931]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c, portal: 172.16.0.220,3260] successful.
Nov 16 19:25:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1c652c0-45d9-47bd-8108-cf96fd0b9a8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787d2f2-27f6-4d3d-83d9-bc6cab79d919]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] <== disconnect_volume: return (436ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG nova.objects.instance [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lazy-loading 'flavor' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-52d10e65-164f-4a3c-bb39-f84f23a23fa6 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:09 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Waiting for libvirt event about the detach of device tap79db1954-0b with device alias net1 from instance 7269c7b0-d837-4201-8695-83eeb7c7824f is timed out.
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 19:25:09 user nova-compute[86931]:   <name>instance-00000008</name>
Nov 16 19:25:09 user nova-compute[86931]:   <uuid>7269c7b0-d837-4201-8695-83eeb7c7824f</uuid>
Nov 16 19:25:09 user nova-compute[86931]:   <metadata>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:09 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:24:14</nova:creationTime>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:25:09 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:owner>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:owner>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:ports>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:25:09 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:25:09 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:port uuid="79db1954-0b19-4cf0-9761-25ff2c342044">
Nov 16 19:25:09 user nova-compute[86931]:       <nova:ip type="fixed" address="10.10.10.167" ipVersion="4"/>
Nov 16 19:25:09 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:ports>
Nov 16 19:25:09 user nova-compute[86931]: </nova:instance>
Nov 16 19:25:09 user nova-compute[86931]:   </metadata>
Nov 16 19:25:09 user nova-compute[86931]:   <memory unit='KiB'>524288</memory>
Nov 16 19:25:09 user nova-compute[86931]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 19:25:09 user nova-compute[86931]:   <vcpu placement='static'>1</vcpu>
Nov 16 19:25:09 user nova-compute[86931]:   <resource>
Nov 16 19:25:09 user nova-compute[86931]:     <partition>/machine</partition>
Nov 16 19:25:09 user nova-compute[86931]:   </resource>
Nov 16 19:25:09 user nova-compute[86931]:   <sysinfo type='smbios'>
Nov 16 19:25:09 user nova-compute[86931]:     <system>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='version'>0.0.0</entry>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='serial'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='uuid'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:09 user nova-compute[86931]:       <entry name='family'>Virtual Machine</entry>
Nov 16 19:25:09 user nova-compute[86931]:     </system>
Nov 16 19:25:09 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:09 user nova-compute[86931]:   <os>
Nov 16 19:25:09 user nova-compute[86931]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 19:25:09 user nova-compute[86931]:     <boot dev='hd'/>
Nov 16 19:25:09 user nova-compute[86931]:     <smbios mode='sysinfo'/>
Nov 16 19:25:09 user nova-compute[86931]:   </os>
Nov 16 19:25:09 user nova-compute[86931]:   <features>
Nov 16 19:25:09 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:09 user nova-compute[86931]:     <apic/>
Nov 16 19:25:09 user nova-compute[86931]:     <vmcoreinfo state='on'/>
Nov 16 19:25:09 user nova-compute[86931]:   </features>
Nov 16 19:25:09 user nova-compute[86931]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 19:25:09 user nova-compute[86931]:     <model fallback='forbid'>Nehalem</model>
Nov 16 19:25:09 user nova-compute[86931]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 19:25:09 user nova-compute[86931]:     <feature policy='require' name='vme'/>
Nov 16 19:25:09 user nova-compute[86931]:     <feature policy='require' name='x2apic'/>
Nov 16 19:25:09 user nova-compute[86931]:     <feature policy='require' name='hypervisor'/>
Nov 16 19:25:09 user nova-compute[86931]:   </cpu>
Nov 16 19:25:09 user nova-compute[86931]:   <clock offset='utc'>
Nov 16 19:25:09 user nova-compute[86931]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 19:25:09 user nova-compute[86931]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 19:25:09 user nova-compute[86931]:     <timer name='hpet' present='no'/>
Nov 16 19:25:09 user nova-compute[86931]:   </clock>
Nov 16 19:25:09 user nova-compute[86931]:   <on_poweroff>destroy</on_poweroff>
Nov 16 19:25:09 user nova-compute[86931]:   <on_reboot>restart</on_reboot>
Nov 16 19:25:09 user nova-compute[86931]:   <on_crash>destroy</on_crash>
Nov 16 19:25:09 user nova-compute[86931]:   <devices>
Nov 16 19:25:09 user nova-compute[86931]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 19:25:09 user nova-compute[86931]:     <disk type='file' device='disk'>
Nov 16 19:25:09 user nova-compute[86931]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 19:25:09 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk' index='2'/>
Nov 16 19:25:09 user nova-compute[86931]:       <backingStore type='file' index='3'>
Nov 16 19:25:09 user nova-compute[86931]:         <format type='raw'/>
Nov 16 19:25:09 user nova-compute[86931]:         <source file='/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93'/>
Nov 16 19:25:09 user nova-compute[86931]:         <backingStore/>
Nov 16 19:25:09 user nova-compute[86931]:       </backingStore>
Nov 16 19:25:09 user nova-compute[86931]:       <target dev='vda' bus='virtio'/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='virtio-disk0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </disk>
Nov 16 19:25:09 user nova-compute[86931]:     <disk type='file' device='cdrom'>
Nov 16 19:25:09 user nova-compute[86931]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 19:25:09 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config' index='1'/>
Nov 16 19:25:09 user nova-compute[86931]:       <backingStore/>
Nov 16 19:25:09 user nova-compute[86931]:       <target dev='hda' bus='ide'/>
Nov 16 19:25:09 user nova-compute[86931]:       <readonly/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='ide0-0-0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </disk>
Nov 16 19:25:09 user nova-compute[86931]:     <controller type='usb' index='0' model='none'>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='usb'/>
Nov 16 19:25:09 user nova-compute[86931]:     </controller>
Nov 16 19:25:09 user nova-compute[86931]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='pci.0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </controller>
Nov 16 19:25:09 user nova-compute[86931]:     <controller type='ide' index='0'>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='ide'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 19:25:09 user nova-compute[86931]:     </controller>
Nov 16 19:25:09 user nova-compute[86931]:     <interface type='ethernet'>
Nov 16 19:25:09 user nova-compute[86931]:       <mac address='fa:16:3e:47:4f:09'/>
Nov 16 19:25:09 user nova-compute[86931]:       <target dev='tap83c9ef40-99'/>
Nov 16 19:25:09 user nova-compute[86931]:       <model type='virtio'/>
Nov 16 19:25:09 user nova-compute[86931]:       <mtu size='1442'/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='net0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </interface>
Nov 16 19:25:09 user nova-compute[86931]:     <serial type='pty'>
Nov 16 19:25:09 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:09 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:09 user nova-compute[86931]:       <target type='isa-serial' port='0'>
Nov 16 19:25:09 user nova-compute[86931]:         <model name='isa-serial'/>
Nov 16 19:25:09 user nova-compute[86931]:       </target>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </serial>
Nov 16 19:25:09 user nova-compute[86931]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 19:25:09 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:09 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:09 user nova-compute[86931]:       <target type='serial' port='0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </console>
Nov 16 19:25:09 user nova-compute[86931]:     <input type='mouse' bus='ps2'>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='input0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </input>
Nov 16 19:25:09 user nova-compute[86931]:     <input type='keyboard' bus='ps2'>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='input1'/>
Nov 16 19:25:09 user nova-compute[86931]:     </input>
Nov 16 19:25:09 user nova-compute[86931]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 19:25:09 user nova-compute[86931]:       <listen type='address' address='0.0.0.0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </graphics>
Nov 16 19:25:09 user nova-compute[86931]:     <audio id='1' type='none'/>
Nov 16 19:25:09 user nova-compute[86931]:     <video>
Nov 16 19:25:09 user nova-compute[86931]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='video0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </video>
Nov 16 19:25:09 user nova-compute[86931]:     <memballoon model='virtio'>
Nov 16 19:25:09 user nova-compute[86931]:       <stats period='10'/>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='balloon0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:09 user nova-compute[86931]:     <rng model='virtio'>
Nov 16 19:25:09 user nova-compute[86931]:       <backend model='random'>/dev/urandom</backend>
Nov 16 19:25:09 user nova-compute[86931]:       <alias name='rng0'/>
Nov 16 19:25:09 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 19:25:09 user nova-compute[86931]:     </rng>
Nov 16 19:25:09 user nova-compute[86931]:   </devices>
Nov 16 19:25:09 user nova-compute[86931]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 19:25:09 user nova-compute[86931]:     <label>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</label>
Nov 16 19:25:09 user nova-compute[86931]:     <imagelabel>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</imagelabel>
Nov 16 19:25:09 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:09 user nova-compute[86931]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 19:25:09 user nova-compute[86931]:     <label>+64055:+108</label>
Nov 16 19:25:09 user nova-compute[86931]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 19:25:09 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:09 user nova-compute[86931]: </domain>
Nov 16 19:25:09 user nova-compute[86931]:  {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 19:25:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully detached device tap79db1954-0b from instance 7269c7b0-d837-4201-8695-83eeb7c7824f from the live domain config.
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG os_vif [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79db1954-0b, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd9284fd-f41d-4a7d-ba52-763c4406af0a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:09 user nova-compute[86931]: INFO os_vif [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b')
Nov 16 19:25:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:09 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:25:09</nova:creationTime>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:25:09 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:owner>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:owner>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:09 user nova-compute[86931]:   <nova:ports>
Nov 16 19:25:09 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:25:09 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:25:09 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:09 user nova-compute[86931]:   </nova:ports>
Nov 16 19:25:09 user nova-compute[86931]: </nova:instance>
Nov 16 19:25:09 user nova-compute[86931]:  {{(pid=86931) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-deleted-79db1954-0b19-4cf0-9761-25ff2c342044 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:10 user nova-compute[86931]: INFO nova.compute.manager [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Neutron deleted interface 79db1954-0b19-4cf0-9761-25ff2c342044; detaching it from the instance and deleting it from the info cache
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquired lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.objects.instance [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Lazy-loading 'system_metadata' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.objects.instance [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Lazy-loading 'flavor' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.objects.base [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Object Instance<7269c7b0-d837-4201-8695-83eeb7c7824f> lazy-loaded attributes: system_metadata,flavor {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 19:25:10 user nova-compute[86931]:   <name>instance-00000008</name>
Nov 16 19:25:10 user nova-compute[86931]:   <uuid>7269c7b0-d837-4201-8695-83eeb7c7824f</uuid>
Nov 16 19:25:10 user nova-compute[86931]:   <metadata>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:10 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:25:09</nova:creationTime>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:25:10 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:ports>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:25:10 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:25:10 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:ports>
Nov 16 19:25:10 user nova-compute[86931]: </nova:instance>
Nov 16 19:25:10 user nova-compute[86931]:   </metadata>
Nov 16 19:25:10 user nova-compute[86931]:   <memory unit='KiB'>524288</memory>
Nov 16 19:25:10 user nova-compute[86931]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 19:25:10 user nova-compute[86931]:   <vcpu placement='static'>1</vcpu>
Nov 16 19:25:10 user nova-compute[86931]:   <resource>
Nov 16 19:25:10 user nova-compute[86931]:     <partition>/machine</partition>
Nov 16 19:25:10 user nova-compute[86931]:   </resource>
Nov 16 19:25:10 user nova-compute[86931]:   <sysinfo type='smbios'>
Nov 16 19:25:10 user nova-compute[86931]:     <system>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='version'>0.0.0</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='serial'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='uuid'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='family'>Virtual Machine</entry>
Nov 16 19:25:10 user nova-compute[86931]:     </system>
Nov 16 19:25:10 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:10 user nova-compute[86931]:   <os>
Nov 16 19:25:10 user nova-compute[86931]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 19:25:10 user nova-compute[86931]:     <boot dev='hd'/>
Nov 16 19:25:10 user nova-compute[86931]:     <smbios mode='sysinfo'/>
Nov 16 19:25:10 user nova-compute[86931]:   </os>
Nov 16 19:25:10 user nova-compute[86931]:   <features>
Nov 16 19:25:10 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:10 user nova-compute[86931]:     <apic/>
Nov 16 19:25:10 user nova-compute[86931]:     <vmcoreinfo state='on'/>
Nov 16 19:25:10 user nova-compute[86931]:   </features>
Nov 16 19:25:10 user nova-compute[86931]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 19:25:10 user nova-compute[86931]:     <model fallback='forbid'>Nehalem</model>
Nov 16 19:25:10 user nova-compute[86931]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='vme'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='x2apic'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='hypervisor'/>
Nov 16 19:25:10 user nova-compute[86931]:   </cpu>
Nov 16 19:25:10 user nova-compute[86931]:   <clock offset='utc'>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='hpet' present='no'/>
Nov 16 19:25:10 user nova-compute[86931]:   </clock>
Nov 16 19:25:10 user nova-compute[86931]:   <on_poweroff>destroy</on_poweroff>
Nov 16 19:25:10 user nova-compute[86931]:   <on_reboot>restart</on_reboot>
Nov 16 19:25:10 user nova-compute[86931]:   <on_crash>destroy</on_crash>
Nov 16 19:25:10 user nova-compute[86931]:   <devices>
Nov 16 19:25:10 user nova-compute[86931]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 19:25:10 user nova-compute[86931]:     <disk type='file' device='disk'>
Nov 16 19:25:10 user nova-compute[86931]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 19:25:10 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk' index='2'/>
Nov 16 19:25:10 user nova-compute[86931]:       <backingStore type='file' index='3'>
Nov 16 19:25:10 user nova-compute[86931]:         <format type='raw'/>
Nov 16 19:25:10 user nova-compute[86931]:         <source file='/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93'/>
Nov 16 19:25:10 user nova-compute[86931]:         <backingStore/>
Nov 16 19:25:10 user nova-compute[86931]:       </backingStore>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='vda' bus='virtio'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='virtio-disk0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </disk>
Nov 16 19:25:10 user nova-compute[86931]:     <disk type='file' device='cdrom'>
Nov 16 19:25:10 user nova-compute[86931]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 19:25:10 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config' index='1'/>
Nov 16 19:25:10 user nova-compute[86931]:       <backingStore/>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='hda' bus='ide'/>
Nov 16 19:25:10 user nova-compute[86931]:       <readonly/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='ide0-0-0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </disk>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='usb' index='0' model='none'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='usb'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='pci.0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='ide' index='0'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='ide'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <interface type='ethernet'>
Nov 16 19:25:10 user nova-compute[86931]:       <mac address='fa:16:3e:47:4f:09'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='tap83c9ef40-99'/>
Nov 16 19:25:10 user nova-compute[86931]:       <model type='virtio'/>
Nov 16 19:25:10 user nova-compute[86931]:       <mtu size='1442'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='net0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </interface>
Nov 16 19:25:10 user nova-compute[86931]:     <serial type='pty'>
Nov 16 19:25:10 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:10 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target type='isa-serial' port='0'>
Nov 16 19:25:10 user nova-compute[86931]:         <model name='isa-serial'/>
Nov 16 19:25:10 user nova-compute[86931]:       </target>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </serial>
Nov 16 19:25:10 user nova-compute[86931]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 19:25:10 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:10 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target type='serial' port='0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </console>
Nov 16 19:25:10 user nova-compute[86931]:     <input type='mouse' bus='ps2'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='input0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </input>
Nov 16 19:25:10 user nova-compute[86931]:     <input type='keyboard' bus='ps2'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='input1'/>
Nov 16 19:25:10 user nova-compute[86931]:     </input>
Nov 16 19:25:10 user nova-compute[86931]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 19:25:10 user nova-compute[86931]:       <listen type='address' address='0.0.0.0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </graphics>
Nov 16 19:25:10 user nova-compute[86931]:     <audio id='1' type='none'/>
Nov 16 19:25:10 user nova-compute[86931]:     <video>
Nov 16 19:25:10 user nova-compute[86931]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='video0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </video>
Nov 16 19:25:10 user nova-compute[86931]:     <memballoon model='virtio'>
Nov 16 19:25:10 user nova-compute[86931]:       <stats period='10'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='balloon0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:10 user nova-compute[86931]:     <rng model='virtio'>
Nov 16 19:25:10 user nova-compute[86931]:       <backend model='random'>/dev/urandom</backend>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='rng0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </rng>
Nov 16 19:25:10 user nova-compute[86931]:   </devices>
Nov 16 19:25:10 user nova-compute[86931]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 19:25:10 user nova-compute[86931]:     <label>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</label>
Nov 16 19:25:10 user nova-compute[86931]:     <imagelabel>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</imagelabel>
Nov 16 19:25:10 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:10 user nova-compute[86931]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 19:25:10 user nova-compute[86931]:     <label>+64055:+108</label>
Nov 16 19:25:10 user nova-compute[86931]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 19:25:10 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:10 user nova-compute[86931]: </domain>
Nov 16 19:25:10 user nova-compute[86931]:  {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface> {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:9b:10"/><model type="virtio"/><mtu size="1442"/><target dev="tap79db1954-0b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 19:25:10 user nova-compute[86931]:   <name>instance-00000008</name>
Nov 16 19:25:10 user nova-compute[86931]:   <uuid>7269c7b0-d837-4201-8695-83eeb7c7824f</uuid>
Nov 16 19:25:10 user nova-compute[86931]:   <metadata>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:10 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:25:09</nova:creationTime>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:25:10 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:ports>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:25:10 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:25:10 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:ports>
Nov 16 19:25:10 user nova-compute[86931]: </nova:instance>
Nov 16 19:25:10 user nova-compute[86931]:   </metadata>
Nov 16 19:25:10 user nova-compute[86931]:   <memory unit='KiB'>524288</memory>
Nov 16 19:25:10 user nova-compute[86931]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 19:25:10 user nova-compute[86931]:   <vcpu placement='static'>1</vcpu>
Nov 16 19:25:10 user nova-compute[86931]:   <resource>
Nov 16 19:25:10 user nova-compute[86931]:     <partition>/machine</partition>
Nov 16 19:25:10 user nova-compute[86931]:   </resource>
Nov 16 19:25:10 user nova-compute[86931]:   <sysinfo type='smbios'>
Nov 16 19:25:10 user nova-compute[86931]:     <system>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='version'>0.0.0</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='serial'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='uuid'>7269c7b0-d837-4201-8695-83eeb7c7824f</entry>
Nov 16 19:25:10 user nova-compute[86931]:       <entry name='family'>Virtual Machine</entry>
Nov 16 19:25:10 user nova-compute[86931]:     </system>
Nov 16 19:25:10 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:10 user nova-compute[86931]:   <os>
Nov 16 19:25:10 user nova-compute[86931]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 19:25:10 user nova-compute[86931]:     <boot dev='hd'/>
Nov 16 19:25:10 user nova-compute[86931]:     <smbios mode='sysinfo'/>
Nov 16 19:25:10 user nova-compute[86931]:   </os>
Nov 16 19:25:10 user nova-compute[86931]:   <features>
Nov 16 19:25:10 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:10 user nova-compute[86931]:     <apic/>
Nov 16 19:25:10 user nova-compute[86931]:     <vmcoreinfo state='on'/>
Nov 16 19:25:10 user nova-compute[86931]:   </features>
Nov 16 19:25:10 user nova-compute[86931]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 19:25:10 user nova-compute[86931]:     <model fallback='forbid'>Nehalem</model>
Nov 16 19:25:10 user nova-compute[86931]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='vme'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='x2apic'/>
Nov 16 19:25:10 user nova-compute[86931]:     <feature policy='require' name='hypervisor'/>
Nov 16 19:25:10 user nova-compute[86931]:   </cpu>
Nov 16 19:25:10 user nova-compute[86931]:   <clock offset='utc'>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 19:25:10 user nova-compute[86931]:     <timer name='hpet' present='no'/>
Nov 16 19:25:10 user nova-compute[86931]:   </clock>
Nov 16 19:25:10 user nova-compute[86931]:   <on_poweroff>destroy</on_poweroff>
Nov 16 19:25:10 user nova-compute[86931]:   <on_reboot>restart</on_reboot>
Nov 16 19:25:10 user nova-compute[86931]:   <on_crash>destroy</on_crash>
Nov 16 19:25:10 user nova-compute[86931]:   <devices>
Nov 16 19:25:10 user nova-compute[86931]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 19:25:10 user nova-compute[86931]:     <disk type='file' device='disk'>
Nov 16 19:25:10 user nova-compute[86931]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 19:25:10 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk' index='2'/>
Nov 16 19:25:10 user nova-compute[86931]:       <backingStore type='file' index='3'>
Nov 16 19:25:10 user nova-compute[86931]:         <format type='raw'/>
Nov 16 19:25:10 user nova-compute[86931]:         <source file='/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93'/>
Nov 16 19:25:10 user nova-compute[86931]:         <backingStore/>
Nov 16 19:25:10 user nova-compute[86931]:       </backingStore>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='vda' bus='virtio'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='virtio-disk0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </disk>
Nov 16 19:25:10 user nova-compute[86931]:     <disk type='file' device='cdrom'>
Nov 16 19:25:10 user nova-compute[86931]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 19:25:10 user nova-compute[86931]:       <source file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk.config' index='1'/>
Nov 16 19:25:10 user nova-compute[86931]:       <backingStore/>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='hda' bus='ide'/>
Nov 16 19:25:10 user nova-compute[86931]:       <readonly/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='ide0-0-0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </disk>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='usb' index='0' model='none'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='usb'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='pci.0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <controller type='ide' index='0'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='ide'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 19:25:10 user nova-compute[86931]:     </controller>
Nov 16 19:25:10 user nova-compute[86931]:     <interface type='ethernet'>
Nov 16 19:25:10 user nova-compute[86931]:       <mac address='fa:16:3e:47:4f:09'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target dev='tap83c9ef40-99'/>
Nov 16 19:25:10 user nova-compute[86931]:       <model type='virtio'/>
Nov 16 19:25:10 user nova-compute[86931]:       <mtu size='1442'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='net0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </interface>
Nov 16 19:25:10 user nova-compute[86931]:     <serial type='pty'>
Nov 16 19:25:10 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:10 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target type='isa-serial' port='0'>
Nov 16 19:25:10 user nova-compute[86931]:         <model name='isa-serial'/>
Nov 16 19:25:10 user nova-compute[86931]:       </target>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </serial>
Nov 16 19:25:10 user nova-compute[86931]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 19:25:10 user nova-compute[86931]:       <source path='/dev/pts/7'/>
Nov 16 19:25:10 user nova-compute[86931]:       <log file='/opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/console.log' append='off'/>
Nov 16 19:25:10 user nova-compute[86931]:       <target type='serial' port='0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='serial0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </console>
Nov 16 19:25:10 user nova-compute[86931]:     <input type='mouse' bus='ps2'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='input0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </input>
Nov 16 19:25:10 user nova-compute[86931]:     <input type='keyboard' bus='ps2'>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='input1'/>
Nov 16 19:25:10 user nova-compute[86931]:     </input>
Nov 16 19:25:10 user nova-compute[86931]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 19:25:10 user nova-compute[86931]:       <listen type='address' address='0.0.0.0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </graphics>
Nov 16 19:25:10 user nova-compute[86931]:     <audio id='1' type='none'/>
Nov 16 19:25:10 user nova-compute[86931]:     <video>
Nov 16 19:25:10 user nova-compute[86931]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='video0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </video>
Nov 16 19:25:10 user nova-compute[86931]:     <memballoon model='virtio'>
Nov 16 19:25:10 user nova-compute[86931]:       <stats period='10'/>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='balloon0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:10 user nova-compute[86931]:     <rng model='virtio'>
Nov 16 19:25:10 user nova-compute[86931]:       <backend model='random'>/dev/urandom</backend>
Nov 16 19:25:10 user nova-compute[86931]:       <alias name='rng0'/>
Nov 16 19:25:10 user nova-compute[86931]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 19:25:10 user nova-compute[86931]:     </rng>
Nov 16 19:25:10 user nova-compute[86931]:   </devices>
Nov 16 19:25:10 user nova-compute[86931]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 19:25:10 user nova-compute[86931]:     <label>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</label>
Nov 16 19:25:10 user nova-compute[86931]:     <imagelabel>libvirt-7269c7b0-d837-4201-8695-83eeb7c7824f</imagelabel>
Nov 16 19:25:10 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:10 user nova-compute[86931]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 19:25:10 user nova-compute[86931]:     <label>+64055:+108</label>
Nov 16 19:25:10 user nova-compute[86931]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 19:25:10 user nova-compute[86931]:   </seclabel>
Nov 16 19:25:10 user nova-compute[86931]: </domain>
Nov 16 19:25:10 user nova-compute[86931]:  {{(pid=86931) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 19:25:10 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Detaching interface fa:16:3e:c9:9b:10 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap79db1954-0b' not found.
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Converting VIF {"id": "79db1954-0b19-4cf0-9761-25ff2c342044", "address": "fa:16:3e:c9:9b:10", "network": {"id": "0397152c-0e7a-4d11-bf1d-659ab215543c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-861105757", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79db1954-0b", "ovs_interfaceid": "79db1954-0b19-4cf0-9761-25ff2c342044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG os_vif [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79db1954-0b, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:25:10 user nova-compute[86931]: INFO os_vif [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=79db1954-0b19-4cf0-9761-25ff2c342044,network=Network(0397152c-0e7a-4d11-bf1d-659ab215543c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79db1954-0b')
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [req-9efdc032-8d4d-475f-b31d-5aaadd167cc9 req-166743a3-957c-48df-b2a3-c1b81b2063c1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:10 user nova-compute[86931]:   <nova:package version="0.0.0"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:name>tempest-device-tagging-server-383828231</nova:name>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:creationTime>2023-11-16 19:25:10</nova:creationTime>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:flavor name="m1.tiny">
Nov 16 19:25:10 user nova-compute[86931]:     <nova:memory>512</nova:memory>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:disk>1</nova:disk>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:swap>0</nova:swap>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:flavor>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:user uuid="88c6d9ee1c274f6fae59529b07f83b12">tempest-TaggedAttachmentsTest-1347621221-project-member</nova:user>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:project uuid="f9c91d63d28847aa9d297f9c03c4af2f">tempest-TaggedAttachmentsTest-1347621221</nova:project>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:owner>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:10 user nova-compute[86931]:   <nova:ports>
Nov 16 19:25:10 user nova-compute[86931]:     <nova:port uuid="83c9ef40-990a-44af-a396-98a5de566b42">
Nov 16 19:25:10 user nova-compute[86931]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:25:10 user nova-compute[86931]:     </nova:port>
Nov 16 19:25:10 user nova-compute[86931]:   </nova:ports>
Nov 16 19:25:10 user nova-compute[86931]: </nova:instance>
Nov 16 19:25:10 user nova-compute[86931]:  {{(pid=86931) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 19:25:10 user nova-compute[86931]: INFO nova.network.neutron [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Port 79db1954-0b19-4cf0-9761-25ff2c342044 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 16 19:25:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [{"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Releasing lock "refresh_cache-7269c7b0-d837-4201-8695-83eeb7c7824f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2a2e517f-ed31-4bdd-a2e1-570d397d2aa9 tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "interface-7269c7b0-d837-4201-8695-83eeb7c7824f-79db1954-0b19-4cf0-9761-25ff2c342044" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.481s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:21 user nova-compute[86931]: INFO nova.compute.manager [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Terminating instance
Nov 16 19:25:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-unplugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] No waiting events found dispatching network-vif-unplugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-67467aab-e589-495f-b864-c2854634ffb4 req-c2655707-2528-4b96-ba78-74bbcf6e8627 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-unplugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:25:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Instance destroyed successfully.
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lazy-loading 'resources' on Instance uuid 782a1af8-63f6-4630-b5e2-5819e75c1673 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1946137696',display_name='tempest-VolumesAssistedSnapshotsTest-server-1946137696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1946137696',id=10,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA0uKjdy9dwU3KNblG4s6llYMYqpUUXzcfc0lw6edCfp+TJz+peFqS4RauWNhc71FwwPKwZRnoyNHtUAJ/Jx9LxvJxPUKgvDp33tkvDxc260X7G6PyxVuB65WNxbqeEfQ==',key_name='tempest-keypair-434943254',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ac8cb13963148c985bd5efcce34ab15',ramdisk_id='',reservation_id='r-xtxf04vx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1635337682',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1635337682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321517bf41bd4248aef2567a53f901d9',uuid=782a1af8-63f6-4630-b5e2-5819e75c1673,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converting VIF {"id": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "address": "fa:16:3e:18:f6:74", "network": {"id": "c8138ec2-a127-4782-b960-7976ce28992a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1277444687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ac8cb13963148c985bd5efcce34ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec091bb-39", "ovs_interfaceid": "bec091bb-3963-4c71-9dec-aa44ebaf4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG os_vif [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbec091bb-39, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6fde818-2f4b-4b92-8fa9-c7d5dfd6866a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:22 user nova-compute[86931]: INFO os_vif [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f6:74,bridge_name='br-int',has_traffic_filtering=True,id=bec091bb-3963-4c71-9dec-aa44ebaf4a7b,network=Network(c8138ec2-a127-4782-b960-7976ce28992a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec091bb-39')
Nov 16 19:25:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Deleting instance files /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673_del
Nov 16 19:25:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Deletion of /opt/stack/data/nova/instances/782a1af8-63f6-4630-b5e2-5819e75c1673_del complete
Nov 16 19:25:22 user nova-compute[86931]: INFO nova.compute.manager [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:25:22 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:25:22 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:23 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Took 0.75 seconds to deallocate network for instance.
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-44bf9ee9-bd71-42ea-9c0b-8a06aedab8aa req-2509194d-f99e-403e-a09b-7c6fa646b934 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-deleted-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:23 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Deleted allocations for instance 782a1af8-63f6-4630-b5e2-5819e75c1673
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-efbc1268-b403-48ec-a2f7-ec83d025960e tempest-VolumesAssistedSnapshotsTest-1635337682 tempest-VolumesAssistedSnapshotsTest-1635337682-project-member] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] Acquiring lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] Lock "782a1af8-63f6-4630-b5e2-5819e75c1673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] No waiting events found dispatching network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:23 user nova-compute[86931]: WARNING nova.compute.manager [req-cdaa9823-3c37-4532-b0cc-c27d92eeac37 req-1ade92aa-147e-4599-a510-f7d6eaec5300 service nova] [instance: 782a1af8-63f6-4630-b5e2-5819e75c1673] Received unexpected event network-vif-plugged-bec091bb-3963-4c71-9dec-aa44ebaf4a7b for instance with vm_state deleted and task_state None.
Nov 16 19:25:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:25:31 user nova-compute[86931]: INFO nova.compute.claims [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Claim successful on node user
Nov 16 19:25:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:25:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.policy [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c74086febf834740bbe6d094ebad864b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823d93d9aed54ef0aac913d3707f207f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:25:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Creating image(s)
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.227s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk 1073741824" returned: 0 in 0.255s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.490s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Cannot resize image /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Ensure instance console log exists: /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Successfully created port: 62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Successfully updated port: 62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-changed-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Refreshing instance network info cache due to event network-changed-62d53c11-d15d-4af9-a560-8911e3dcaeb9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] Acquiring lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.neutron [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating instance_info_cache with network_info: [{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance network_info: |[{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] Acquired lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Refreshing network info cache for port 62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start _get_guest_xml network_info=[{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:25:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-tempest.common.compute-instance-1491216944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:25:34 user nova-compute[86931]:   <uuid>3a3edd48-2e72-4195-a366-06ec5e34b496</uuid>
Nov 16 19:25:34 user nova-compute[86931]:   <name>instance-0000000e</name>
Nov 16 19:25:34 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:25:34 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:25:34 user nova-compute[86931]:   <metadata>
Nov 16 19:25:34 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:34 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:name>tempest-tempest.common.compute-instance-1491216944</nova:name>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:25:34</nova:creationTime>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:25:34 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:34 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:owner>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:user uuid="c74086febf834740bbe6d094ebad864b">tempest-ServerActionsTestOtherA-672558396-project-member</nova:user>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:project uuid="823d93d9aed54ef0aac913d3707f207f">tempest-ServerActionsTestOtherA-672558396</nova:project>
Nov 16 19:25:34 user nova-compute[86931]:       </nova:owner>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:34 user nova-compute[86931]:       <nova:ports>
Nov 16 19:25:34 user nova-compute[86931]:         <nova:port uuid="62d53c11-d15d-4af9-a560-8911e3dcaeb9">
Nov 16 19:25:34 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 19:25:34 user nova-compute[86931]:         </nova:port>
Nov 16 19:25:34 user nova-compute[86931]:       </nova:ports>
Nov 16 19:25:34 user nova-compute[86931]:     </nova:instance>
Nov 16 19:25:34 user nova-compute[86931]:   </metadata>
Nov 16 19:25:34 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:25:34 user nova-compute[86931]:     <system>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="serial">3a3edd48-2e72-4195-a366-06ec5e34b496</entry>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="uuid">3a3edd48-2e72-4195-a366-06ec5e34b496</entry>
Nov 16 19:25:34 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:25:34 user nova-compute[86931]:     </system>
Nov 16 19:25:34 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:34 user nova-compute[86931]:   <os>
Nov 16 19:25:34 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:25:34 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:25:34 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:25:34 user nova-compute[86931]:   </os>
Nov 16 19:25:34 user nova-compute[86931]:   <features>
Nov 16 19:25:34 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:34 user nova-compute[86931]:     <apic/>
Nov 16 19:25:34 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:25:34 user nova-compute[86931]:   </features>
Nov 16 19:25:34 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:25:34 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:25:34 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:25:34 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:25:34 user nova-compute[86931]:   </clock>
Nov 16 19:25:34 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:25:34 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:25:34 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:25:34 user nova-compute[86931]:   </cpu>
Nov 16 19:25:34 user nova-compute[86931]:   <devices>
Nov 16 19:25:34 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:25:34 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:25:34 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk"/>
Nov 16 19:25:34 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:25:34 user nova-compute[86931]:     </disk>
Nov 16 19:25:34 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:25:34 user nova-compute[86931]:       <mac address="fa:16:3e:4f:4c:61"/>
Nov 16 19:25:34 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:34 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:25:34 user nova-compute[86931]:       <target dev="tap62d53c11-d1"/>
Nov 16 19:25:34 user nova-compute[86931]:     </interface>
Nov 16 19:25:34 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:25:34 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/console.log" append="off"/>
Nov 16 19:25:34 user nova-compute[86931]:     </serial>
Nov 16 19:25:34 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:25:34 user nova-compute[86931]:     <video>
Nov 16 19:25:34 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:34 user nova-compute[86931]:     </video>
Nov 16 19:25:34 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:25:34 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:25:34 user nova-compute[86931]:     </rng>
Nov 16 19:25:34 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:25:34 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:25:34 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:25:34 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:34 user nova-compute[86931]:   </devices>
Nov 16 19:25:34 user nova-compute[86931]: </domain>
Nov 16 19:25:34 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-tempest.common.compute-instance-1491216944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG os_vif [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8b39e6b-b99e-5024-bcdb-6dc788720584', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d53c11-d1, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62d53c11-d1, col_values=(('qos', UUID('e11eef2f-986a-44ec-beb8-a9091a36825c')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62d53c11-d1, col_values=(('external_ids', {'iface-id': '62d53c11-d15d-4af9-a560-8911e3dcaeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:4c:61', 'vm-uuid': '3a3edd48-2e72-4195-a366-06ec5e34b496'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:34 user nova-compute[86931]: INFO os_vif [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1')
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:4f:4c:61, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updated VIF entry in instance network info cache for port 62d53c11-d15d-4af9-a560-8911e3dcaeb9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG nova.network.neutron [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating instance_info_cache with network_info: [{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97bdfa4f-7bea-46c0-aa30-77ac5d724fd8 req-c8ef4075-f06d-44c5-ae16-1fa82d103e23 service nova] Releasing lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:35 user nova-compute[86931]: INFO nova.compute.manager [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Terminating instance
Nov 16 19:25:35 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-unplugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] No waiting events found dispatching network-vif-unplugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6f6984b-bfe3-48c0-b392-16e876267643 req-73c19969-062d-4b2a-b807-5ed9da16f92f service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-unplugged-46896ae9-01ff-4227-a74f-5d956d539d46 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Instance destroyed successfully.
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lazy-loading 'resources' on Instance uuid b4834f6f-9cdd-450e-bf08-e49d353c3574 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-405950652',display_name='tempest-TestVolumeSwap-server-405950652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-405950652',id=6,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd3rsGDx0tEGLEprkvlfOaeoCCiu/QmgI9BhfYpKxlIz8Z2WoxhYRflmnLrMAm5Adu0KfI6ZcI/AHRFLAVJq6vuuJJ97EL2PBtosczWBU+x0xYYIJzgWvQZLQdn4qkLYw==',key_name='tempest-keypair-1340648349',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7813f165270042ce84a735f3ae066f8a',ramdisk_id='',reservation_id='r-r3811gbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1084200294',owner_user_name='tempest-TestVolumeSwap-1084200294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25a76c9dee8244a6b30c7d0bd55dc908',uuid=b4834f6f-9cdd-450e-bf08-e49d353c3574,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converting VIF {"id": "46896ae9-01ff-4227-a74f-5d956d539d46", "address": "fa:16:3e:02:1c:f3", "network": {"id": "9a61cca6-fa91-4366-a897-1cb80ce8231a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510818642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7813f165270042ce84a735f3ae066f8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46896ae9-01", "ovs_interfaceid": "46896ae9-01ff-4227-a74f-5d956d539d46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG os_vif [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46896ae9-01, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bab7dc5-485e-4ae9-aa31-329f3cc8fda7) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:36 user nova-compute[86931]: INFO os_vif [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1c:f3,bridge_name='br-int',has_traffic_filtering=True,id=46896ae9-01ff-4227-a74f-5d956d539d46,network=Network(9a61cca6-fa91-4366-a897-1cb80ce8231a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46896ae9-01')
Nov 16 19:25:36 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Deleting instance files /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574_del
Nov 16 19:25:36 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Deletion of /opt/stack/data/nova/instances/b4834f6f-9cdd-450e-bf08-e49d353c3574_del complete
Nov 16 19:25:36 user nova-compute[86931]: INFO nova.compute.manager [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 19:25:36 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:25:36 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG nova.network.neutron [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'info_cache' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:25:37 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Acquiring lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] No waiting events found dispatching network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:38 user nova-compute[86931]: WARNING nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received unexpected event network-vif-plugged-46896ae9-01ff-4227-a74f-5d956d539d46 for instance with vm_state active and task_state deleting.
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:38 user nova-compute[86931]: WARNING nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state building and task_state spawning.
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:38 user nova-compute[86931]: WARNING nova.compute.manager [req-41a5ea4c-f131-43ab-9c33-98d3a1f6c842 req-f4e74f2a-41c5-490d-afb3-fe8fb1351852 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state building and task_state spawning.
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:38 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Took 1.97 seconds to deallocate network for instance.
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:38 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance spawned successfully.
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: INFO nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Took 7.18 seconds to spawn the instance on the hypervisor.
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.network.neutron [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:39 user nova-compute[86931]: INFO nova.compute.manager [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Took 8.08 seconds to build instance.
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70767f2b-c6f4-435b-817d-aedfa89378a9 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.188s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance destroyed successfully.
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'resources' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b4eea3-5c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfcd381a-d940-4ce3-8bdf-2b89c7967632) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:39 user nova-compute[86931]: INFO os_vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:25:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0088b822-4f55-4f91-80f5-9809f9c9eeb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:25:39 user nova-compute[86931]: No targets found.
Nov 16 19:25:39 user nova-compute[86931]: iSNS:
Nov 16 19:25:39 user nova-compute[86931]: No targets found.
Nov 16 19:25:39 user nova-compute[86931]: STATIC:
Nov 16 19:25:39 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:25:39 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:39 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:39 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:25:39 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:39 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:39 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:25:39 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:25:39 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:25:39 user nova-compute[86931]: FIRMWARE:
Nov 16 19:25:39 user nova-compute[86931]: No targets found.
Nov 16 19:25:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:25:39 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:25:39 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2184f6-3203-4f74-9716-9b812daa57ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4684064-3d96-45bb-8953-9a6a8f7099dd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c285480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5253f88-cee1-4e2f-9a61-b37dd3e4e57a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.658s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80078053-728e-45fb-afd2-f27debe92857]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b508817a-fa33-48e4-b76b-9fa66b3cb347]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a66cada-e020-4214-ad0f-62f3c0a29954]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3dd47d-6274-48c2-89d5-036e75afd85a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Deleted allocations for instance b4834f6f-9cdd-450e-bf08-e49d353c3574
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814b05f-7baf-4233-add9-1a6cf814fa8e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]
Nov 16 19:25:39 user nova-compute[86931]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.
Nov 16 19:25:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011f0c4-8659-409d-8805-b455a0b70644]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== disconnect_volume: return (427ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start _get_guest_xml network_info=[{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '25f16e59-09b0-4550-aff6-7a21806f8feb', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '08ef1b8a-6ff3-4322-b9ea-7ca7e838a829', 'attached_at': '', 'detached_at': '', 'volume_id': '98febdf2-a358-42d4-803f-c936b5dd1100', 'serial': '98febdf2-a358-42d4-803f-c936b5dd1100'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'numa_topology' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:39 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:39 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3a4617cc-35e5-4ed3-be76-a75d15347d26 tempest-TestVolumeSwap-1084200294 tempest-TestVolumeSwap-1084200294-project-member] Lock "b4834f6f-9cdd-450e-bf08-e49d353c3574" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.348s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:25:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:25:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:25:39 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e76b4-da4e-4a47-bbbf-1da0f9effc6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:25:39 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c923d-935f-4155-be64-49ed4d34401a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100] added
Nov 16 19:25:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[da792136-b643-496d-8ad3-1b4c92a88dbe]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[903a1599-11f6-40dd-bcda-40ac53ec2537]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYaHRvrq {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYaHRvrq" returned: 0 in 0.076s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[698cbb9b-39ba-4a43-8fce-dfa4fc075b88]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYaHRvrq'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4104650-5014-4938-bf4d-26e79d0c2798]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a15f8-c6fc-458f-aed3-40609a2b06d6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:40 user nova-compute[86931]: INFO nova.compute.manager [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Terminating instance
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-2a7f5c86-7c48-4917-b782-2b230526dfd7 req-a6a80736-848a-4834-93fd-f0cae948a072 service nova] [instance: b4834f6f-9cdd-450e-bf08-e49d353c3574] Received event network-vif-deleted-46896ae9-01ff-4227-a74f-5d956d539d46 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f00f4-5f34-4129-80bd-a76fae420c38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]
Nov 16 19:25:40 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.
Nov 16 19:25:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.163s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75e71e-4b64-4dba-a892-71508ea48137]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a6bff-ef17-457b-9712-701d97796450]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:25:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.580s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[84180add-1c70-42df-ae2d-5c6ce5549601]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Instance destroyed successfully.
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lazy-loading 'resources' on Instance uuid 7269c7b0-d837-4201-8695-83eeb7c7824f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-383828231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-383828231',id=8,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBudz7VwQak+xBzFxC3+n5mUioUoqJhaTKDTaMd+TxVwZkgZWpB5OC3YJRPpLuV3qfps0eq9r35BtvbC8LZ4b5tVNw6ubfcZ85ytp9426xCSVbdC3SFo154qyEhs3CZW4g==',key_name='tempest-keypair-1486392110',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c91d63d28847aa9d297f9c03c4af2f',ramdisk_id='',reservation_id='r-63llqzmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1347621221',owner_user_name='tempest-TaggedAttachmentsTest-1347621221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c6d9ee1c274f6fae59529b07f83b12',uuid=7269c7b0-d837-4201-8695-83eeb7c7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converting VIF {"id": "83c9ef40-990a-44af-a396-98a5de566b42", "address": "fa:16:3e:47:4f:09", "network": {"id": "4ef67aef-1168-42b9-888e-ce011beacd73", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1602623854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c91d63d28847aa9d297f9c03c4af2f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83c9ef40-99", "ovs_interfaceid": "83c9ef40-990a-44af-a396-98a5de566b42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG os_vif [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83c9ef40-99, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3743546b-79c9-4748-9601-112c5bbe3620) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: INFO os_vif [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:4f:09,bridge_name='br-int',has_traffic_filtering=True,id=83c9ef40-990a-44af-a396-98a5de566b42,network=Network(4ef67aef-1168-42b9-888e-ce011beacd73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83c9ef40-99')
Nov 16 19:25:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Deleting instance files /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f_del
Nov 16 19:25:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Deletion of /opt/stack/data/nova/instances/7269c7b0-d837-4201-8695-83eeb7c7824f_del complete
Nov 16 19:25:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:41 user nova-compute[86931]: INFO nova.compute.manager [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.624s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== connect_volume: return (1626ms) {'type': 'block', 'scsi_wwn': '23737623730636538', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737623730636538', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'pci_devices' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:25:41 user nova-compute[86931]:   <uuid>08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</uuid>
Nov 16 19:25:41 user nova-compute[86931]:   <name>instance-00000002</name>
Nov 16 19:25:41 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:25:41 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:25:41 user nova-compute[86931]:   <metadata>
Nov 16 19:25:41 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:41 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeTestJSON-server-617281987</nova:name>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:25:39</nova:creationTime>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:25:41 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:41 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:owner>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:user uuid="608adfbbb5d74367a409c645ee871f6c">tempest-AttachVolumeTestJSON-1412638370-project-member</nova:user>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:project uuid="3cfa544a56b847afbf03a50f1e7603f2">tempest-AttachVolumeTestJSON-1412638370</nova:project>
Nov 16 19:25:41 user nova-compute[86931]:       </nova:owner>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:41 user nova-compute[86931]:       <nova:ports>
Nov 16 19:25:41 user nova-compute[86931]:         <nova:port uuid="81b4eea3-5c4e-4a28-8c21-51adc18be286">
Nov 16 19:25:41 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:25:41 user nova-compute[86931]:         </nova:port>
Nov 16 19:25:41 user nova-compute[86931]:       </nova:ports>
Nov 16 19:25:41 user nova-compute[86931]:     </nova:instance>
Nov 16 19:25:41 user nova-compute[86931]:   </metadata>
Nov 16 19:25:41 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:25:41 user nova-compute[86931]:     <system>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="serial">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="uuid">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:25:41 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:25:41 user nova-compute[86931]:     </system>
Nov 16 19:25:41 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:41 user nova-compute[86931]:   <os>
Nov 16 19:25:41 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:25:41 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:25:41 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:25:41 user nova-compute[86931]:   </os>
Nov 16 19:25:41 user nova-compute[86931]:   <features>
Nov 16 19:25:41 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:41 user nova-compute[86931]:     <apic/>
Nov 16 19:25:41 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:25:41 user nova-compute[86931]:   </features>
Nov 16 19:25:41 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:25:41 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:25:41 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:25:41 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:25:41 user nova-compute[86931]:   </clock>
Nov 16 19:25:41 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:25:41 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:25:41 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:25:41 user nova-compute[86931]:   </cpu>
Nov 16 19:25:41 user nova-compute[86931]:   <devices>
Nov 16 19:25:41 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:25:41 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:25:41 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk"/>
Nov 16 19:25:41 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:25:41 user nova-compute[86931]:     </disk>
Nov 16 19:25:41 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:25:41 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:25:41 user nova-compute[86931]:       <source dev="/dev/sdd"/>
Nov 16 19:25:41 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:25:41 user nova-compute[86931]:       <serial>98febdf2-a358-42d4-803f-c936b5dd1100</serial>
Nov 16 19:25:41 user nova-compute[86931]:     </disk>
Nov 16 19:25:41 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:25:41 user nova-compute[86931]:       <mac address="fa:16:3e:00:91:45"/>
Nov 16 19:25:41 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:41 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:25:41 user nova-compute[86931]:       <target dev="tap81b4eea3-5c"/>
Nov 16 19:25:41 user nova-compute[86931]:     </interface>
Nov 16 19:25:41 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:25:41 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/console.log" append="off"/>
Nov 16 19:25:41 user nova-compute[86931]:     </serial>
Nov 16 19:25:41 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:25:41 user nova-compute[86931]:     <video>
Nov 16 19:25:41 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:41 user nova-compute[86931]:     </video>
Nov 16 19:25:41 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:25:41 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:25:41 user nova-compute[86931]:     </rng>
Nov 16 19:25:41 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:25:41 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:25:41 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:25:41 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:41 user nova-compute[86931]:   </devices>
Nov 16 19:25:41 user nova-compute[86931]: </domain>
Nov 16 19:25:41 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.630s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7993MB free_disk=25.580238342285156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7269c7b0-d837-4201-8695-83eeb7c7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e6311dce-9836-41b2-bfc2-c65262aa3012 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance fda35273-3799-4e6c-9170-4cc8779d9b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Cannot resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'migration_context' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG os_vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '313f2824-128d-59aa-a037-c3faadf5b381', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b4eea3-5c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81b4eea3-5c, col_values=(('qos', UUID('ac2a0e6c-8842-4fe9-978d-f6ac72864b14')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81b4eea3-5c, col_values=(('external_ids', {'iface-id': '81b4eea3-5c4e-4a28-8c21-51adc18be286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:91:45', 'vm-uuid': '08ef1b8a-6ff3-4322-b9ea-7ca7e838a829'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:43 user nova-compute[86931]: INFO os_vif [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-unplugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-unplugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-f044ba42-e1ca-4594-a56b-c911d20c24bc req-fa9a0314-fc29-4ba8-a31f-09f0cbe079e5 service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-unplugged-83c9ef40-990a-44af-a396-98a5de566b42 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-a66e890a-41cf-40cb-9b72-ac7281d51476 req-d74cde14-bfa3-4487-b0b3-4d0ed72a7c7d service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-deleted-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:43 user nova-compute[86931]: INFO nova.compute.manager [req-a66e890a-41cf-40cb-9b72-ac7281d51476 req-d74cde14-bfa3-4487-b0b3-4d0ed72a7c7d service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Neutron deleted interface 83c9ef40-990a-44af-a396-98a5de566b42; detaching it from the instance and deleting it from the info cache
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.network.neutron [req-a66e890a-41cf-40cb-9b72-ac7281d51476 req-d74cde14-bfa3-4487-b0b3-4d0ed72a7c7d service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-a66e890a-41cf-40cb-9b72-ac7281d51476 req-d74cde14-bfa3-4487-b0b3-4d0ed72a7c7d service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Detach interface failed, port_id=83c9ef40-990a-44af-a396-98a5de566b42, reason: Instance 7269c7b0-d837-4201-8695-83eeb7c7824f could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:25:43 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Took 2.19 seconds to deallocate network for instance.
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:44 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Deleted allocations for instance 7269c7b0-d837-4201-8695-83eeb7c7824f
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7628ce60-8d32-4135-91da-21b94117c1ad tempest-TaggedAttachmentsTest-1347621221 tempest-TaggedAttachmentsTest-1347621221-project-member] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.121s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:25:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Acquiring lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "7269c7b0-d837-4201-8695-83eeb7c7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] No waiting events found dispatching network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:45 user nova-compute[86931]: WARNING nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 7269c7b0-d837-4201-8695-83eeb7c7824f] Received unexpected event network-vif-plugged-83c9ef40-990a-44af-a396-98a5de566b42 for instance with vm_state deleted and task_state None.
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:45 user nova-compute[86931]: WARNING nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state powering-on.
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:25:45 user nova-compute[86931]: WARNING nova.compute.manager [req-d7edd3a7-3c96-419a-b789-4ebcfa277973 req-081884da-26f0-41ed-a4be-8493a616ba5a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state powering-on.
Nov 16 19:25:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:25:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance rebooted successfully.
Nov 16 19:25:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-2edb8ffb-8273-42d5-a771-d13b969fe5cd tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:25:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:25:55 user nova-compute[86931]: INFO nova.compute.claims [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Claim successful on node user
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:25:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:25:55 user nova-compute[86931]: INFO nova.virt.block_device [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Booting with volume snapshot 2d73838d-430d-49ff-b6b1-eeeba0d98f29 at /dev/vda
Nov 16 19:25:55 user nova-compute[86931]: DEBUG nova.policy [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Successfully created port: 7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:25:56 user nova-compute[86931]: INFO nova.compute.claims [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Claim successful on node user
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:25:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.policy [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fed9425a174047c3b989c98682710c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50446b42a4644f398b94f86d0165d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Successfully updated port: 7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-changed-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Refreshing instance network info cache due to event network-changed-7692f2fb-3168-44ff-b25c-7a90225dc2e7. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] Acquiring lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:25:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Creating image(s)
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "/opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "/opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Updating instance_info_cache with network_info: [{"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk 1073741824" returned: 0 in 0.060s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Instance network_info: |[{"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] Acquired lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Refreshing network info cache for port 7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:25:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Successfully created port: c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Cannot resize image /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Ensure instance console log exists: /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Updated VIF entry in instance network info cache for port 7692f2fb-3168-44ff-b25c-7a90225dc2e7. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Updating instance_info_cache with network_info: [{"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9a9f39e5-bbcd-4c72-8080-c5b2d93bf065 req-ff5885a4-3c44-42fd-ab20-a6ad5f62f6a1 service nova] Releasing lock "refresh_cache-e77e6736-2e09-4eb3-9738-eeaa26eac61b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Successfully updated port: c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquired lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:25:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updating instance_info_cache with network_info: [{"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Releasing lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Instance network_info: |[{"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Start _get_guest_xml network_info=[{"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:25:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-changed-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Refreshing instance network info cache due to event network-changed-c9dbe62b-cd0b-4353-969d-59309eee69c5. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] Acquiring lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] Acquired lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Refreshing network info cache for port c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-952064225',display_name='tempest-ServersNegativeTestJSON-server-952064225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-952064225',id=16,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-5ola1kzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:57Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=9a367ef3-2818-4c3a-b891-5d222491cdde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.objects.instance [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a367ef3-2818-4c3a-b891-5d222491cdde {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:25:59 user nova-compute[86931]:   <uuid>9a367ef3-2818-4c3a-b891-5d222491cdde</uuid>
Nov 16 19:25:59 user nova-compute[86931]:   <name>instance-00000010</name>
Nov 16 19:25:59 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:25:59 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:25:59 user nova-compute[86931]:   <metadata>
Nov 16 19:25:59 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:25:59 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:name>tempest-ServersNegativeTestJSON-server-952064225</nova:name>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:25:59</nova:creationTime>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:25:59 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:25:59 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:owner>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:user uuid="fed9425a174047c3b989c98682710c46">tempest-ServersNegativeTestJSON-715001397-project-member</nova:user>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:project uuid="50446b42a4644f398b94f86d0165d7f8">tempest-ServersNegativeTestJSON-715001397</nova:project>
Nov 16 19:25:59 user nova-compute[86931]:       </nova:owner>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:25:59 user nova-compute[86931]:       <nova:ports>
Nov 16 19:25:59 user nova-compute[86931]:         <nova:port uuid="c9dbe62b-cd0b-4353-969d-59309eee69c5">
Nov 16 19:25:59 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:25:59 user nova-compute[86931]:         </nova:port>
Nov 16 19:25:59 user nova-compute[86931]:       </nova:ports>
Nov 16 19:25:59 user nova-compute[86931]:     </nova:instance>
Nov 16 19:25:59 user nova-compute[86931]:   </metadata>
Nov 16 19:25:59 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:25:59 user nova-compute[86931]:     <system>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="serial">9a367ef3-2818-4c3a-b891-5d222491cdde</entry>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="uuid">9a367ef3-2818-4c3a-b891-5d222491cdde</entry>
Nov 16 19:25:59 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:25:59 user nova-compute[86931]:     </system>
Nov 16 19:25:59 user nova-compute[86931]:   </sysinfo>
Nov 16 19:25:59 user nova-compute[86931]:   <os>
Nov 16 19:25:59 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:25:59 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:25:59 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:25:59 user nova-compute[86931]:   </os>
Nov 16 19:25:59 user nova-compute[86931]:   <features>
Nov 16 19:25:59 user nova-compute[86931]:     <acpi/>
Nov 16 19:25:59 user nova-compute[86931]:     <apic/>
Nov 16 19:25:59 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:25:59 user nova-compute[86931]:   </features>
Nov 16 19:25:59 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:25:59 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:25:59 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:25:59 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:25:59 user nova-compute[86931]:   </clock>
Nov 16 19:25:59 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:25:59 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:25:59 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:25:59 user nova-compute[86931]:   </cpu>
Nov 16 19:25:59 user nova-compute[86931]:   <devices>
Nov 16 19:25:59 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:25:59 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:25:59 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk"/>
Nov 16 19:25:59 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:25:59 user nova-compute[86931]:     </disk>
Nov 16 19:25:59 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:25:59 user nova-compute[86931]:       <mac address="fa:16:3e:e1:38:74"/>
Nov 16 19:25:59 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:59 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:25:59 user nova-compute[86931]:       <target dev="tapc9dbe62b-cd"/>
Nov 16 19:25:59 user nova-compute[86931]:     </interface>
Nov 16 19:25:59 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:25:59 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/console.log" append="off"/>
Nov 16 19:25:59 user nova-compute[86931]:     </serial>
Nov 16 19:25:59 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:25:59 user nova-compute[86931]:     <video>
Nov 16 19:25:59 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:25:59 user nova-compute[86931]:     </video>
Nov 16 19:25:59 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:25:59 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:25:59 user nova-compute[86931]:     </rng>
Nov 16 19:25:59 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:25:59 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:25:59 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:25:59 user nova-compute[86931]:     </memballoon>
Nov 16 19:25:59 user nova-compute[86931]:   </devices>
Nov 16 19:25:59 user nova-compute[86931]: </domain>
Nov 16 19:25:59 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-952064225',display_name='tempest-ServersNegativeTestJSON-server-952064225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-952064225',id=16,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-5ola1kzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:57Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=9a367ef3-2818-4c3a-b891-5d222491cdde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG os_vif [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41162c9b-40ef-5633-b5bb-fd439f4ec08b', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9dbe62b-cd, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9dbe62b-cd, col_values=(('qos', UUID('d8cc7c00-f68f-4623-b28a-2f26b43f50a5')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9dbe62b-cd, col_values=(('external_ids', {'iface-id': 'c9dbe62b-cd0b-4353-969d-59309eee69c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:38:74', 'vm-uuid': '9a367ef3-2818-4c3a-b891-5d222491cdde'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:25:59 user nova-compute[86931]: INFO os_vif [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd')
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] No VIF found with MAC fa:16:3e:e1:38:74, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updated VIF entry in instance network info cache for port c9dbe62b-cd0b-4353-969d-59309eee69c5. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updating instance_info_cache with network_info: [{"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:25:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-376b60e8-4fa1-408c-a129-67233ffae5b7 req-916c74bb-76d6-4b30-8aea-f98e794ee27f service nova] Releasing lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG os_brick.utils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b000a16-4805-41c0-b4c4-d66fc4d01c1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d5b6d-19f8-4eef-9b1d-ffd328b5ad36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff16f81-bea6-46dd-8d08-3a429d79af28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bda828-5e40-4d2b-a958-6a58d079a075]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:26:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:26:02 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:26:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2e7d62-6e3d-48ea-8a28-ab514b21c67d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG os_brick.utils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:26:02 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Updating existing volume attachment record: 58548f3c-c24c-4b60-8389-6c01d15b04e5 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:26:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Instance spawned successfully.
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:03 user nova-compute[86931]: INFO nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:26:03 user nova-compute[86931]: INFO nova.compute.manager [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Took 6.80 seconds to build instance.
Nov 16 19:26:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44920af0-4662-4072-b9c6-40a74b030b57 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.900s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:03 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:26:03 user nova-compute[86931]: INFO nova.compute.claims [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Claim successful on node user
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:26:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:26:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.policy [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e43f609e3244c25bc951e870d50e639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1528a5e3fa244d98aa3ac2231fd3173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:26:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Creating image(s)
Nov 16 19:26:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk 1073741824" returned: 0 in 0.070s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Successfully created port: 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.229s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Cannot resize image /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Ensure instance console log exists: /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] No waiting events found dispatching network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:05 user nova-compute[86931]: WARNING nova.compute.manager [req-45a2bfe2-b700-499c-9afb-5fbea03499c6 req-2532086e-2d1e-4c7a-833d-0184bba6be1b service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received unexpected event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 for instance with vm_state active and task_state None.
Nov 16 19:26:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Successfully updated port: 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing instance network info cache due to event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance network_info: |[{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start _get_guest_xml network_info=[{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:26:06 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:06 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1431386963',display_name='tempest-ServerStableDeviceRescueTest-server-1431386963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1431386963',id=17,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSzYEh+wZ7nuNSMVhh98XEp5OjAKuoAbCz50lqaWXPtCcQ31Da5YhvKJ+JECZY9P2FQMJJ50l9qalXeXUoVIuB52v8dY17SPFqLUZVA2CdWuK5qoV12xVPg7SGgHoVyA==',key_name='tempest-keypair-1478691447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1528a5e3fa244d98aa3ac2231fd3173',ramdisk_id='',reservation_id='r-mu4t02uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1093973425',owner_user_name='tempest-ServerStableDeviceRescueTest-1093973425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e43f609e3244c25bc951e870d50e639',uuid=3b54f114-2b97-4b0b-9149-06347861d653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converting VIF {"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:26:06 user nova-compute[86931]:   <uuid>3b54f114-2b97-4b0b-9149-06347861d653</uuid>
Nov 16 19:26:06 user nova-compute[86931]:   <name>instance-00000011</name>
Nov 16 19:26:06 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:26:06 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:26:06 user nova-compute[86931]:   <metadata>
Nov 16 19:26:06 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:26:06 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1431386963</nova:name>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:26:06</nova:creationTime>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:26:06 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:26:06 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:owner>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:user uuid="4e43f609e3244c25bc951e870d50e639">tempest-ServerStableDeviceRescueTest-1093973425-project-member</nova:user>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:project uuid="b1528a5e3fa244d98aa3ac2231fd3173">tempest-ServerStableDeviceRescueTest-1093973425</nova:project>
Nov 16 19:26:06 user nova-compute[86931]:       </nova:owner>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:26:06 user nova-compute[86931]:       <nova:ports>
Nov 16 19:26:06 user nova-compute[86931]:         <nova:port uuid="8997ab3d-23ec-4b9b-8743-8269f35eb4a0">
Nov 16 19:26:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 19:26:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:26:06 user nova-compute[86931]:       </nova:ports>
Nov 16 19:26:06 user nova-compute[86931]:     </nova:instance>
Nov 16 19:26:06 user nova-compute[86931]:   </metadata>
Nov 16 19:26:06 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:26:06 user nova-compute[86931]:     <system>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="serial">3b54f114-2b97-4b0b-9149-06347861d653</entry>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="uuid">3b54f114-2b97-4b0b-9149-06347861d653</entry>
Nov 16 19:26:06 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:26:06 user nova-compute[86931]:     </system>
Nov 16 19:26:06 user nova-compute[86931]:   </sysinfo>
Nov 16 19:26:06 user nova-compute[86931]:   <os>
Nov 16 19:26:06 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:26:06 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:26:06 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:26:06 user nova-compute[86931]:   </os>
Nov 16 19:26:06 user nova-compute[86931]:   <features>
Nov 16 19:26:06 user nova-compute[86931]:     <acpi/>
Nov 16 19:26:06 user nova-compute[86931]:     <apic/>
Nov 16 19:26:06 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:26:06 user nova-compute[86931]:   </features>
Nov 16 19:26:06 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:26:06 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:26:06 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:26:06 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:26:06 user nova-compute[86931]:   </clock>
Nov 16 19:26:06 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:26:06 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:26:06 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:26:06 user nova-compute[86931]:   </cpu>
Nov 16 19:26:06 user nova-compute[86931]:   <devices>
Nov 16 19:26:06 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:26:06 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:26:06 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk"/>
Nov 16 19:26:06 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:26:06 user nova-compute[86931]:     </disk>
Nov 16 19:26:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:26:06 user nova-compute[86931]:       <mac address="fa:16:3e:96:33:4c"/>
Nov 16 19:26:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:26:06 user nova-compute[86931]:       <target dev="tap8997ab3d-23"/>
Nov 16 19:26:06 user nova-compute[86931]:     </interface>
Nov 16 19:26:06 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:26:06 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/console.log" append="off"/>
Nov 16 19:26:06 user nova-compute[86931]:     </serial>
Nov 16 19:26:06 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:26:06 user nova-compute[86931]:     <video>
Nov 16 19:26:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:06 user nova-compute[86931]:     </video>
Nov 16 19:26:06 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:26:06 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:26:06 user nova-compute[86931]:     </rng>
Nov 16 19:26:06 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:26:06 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:26:06 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:26:06 user nova-compute[86931]:     </memballoon>
Nov 16 19:26:06 user nova-compute[86931]:   </devices>
Nov 16 19:26:06 user nova-compute[86931]: </domain>
Nov 16 19:26:06 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1431386963',display_name='tempest-ServerStableDeviceRescueTest-server-1431386963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1431386963',id=17,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSzYEh+wZ7nuNSMVhh98XEp5OjAKuoAbCz50lqaWXPtCcQ31Da5YhvKJ+JECZY9P2FQMJJ50l9qalXeXUoVIuB52v8dY17SPFqLUZVA2CdWuK5qoV12xVPg7SGgHoVyA==',key_name='tempest-keypair-1478691447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1528a5e3fa244d98aa3ac2231fd3173',ramdisk_id='',reservation_id='r-mu4t02uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1093973425',owner_user_name='tempest-ServerStableDeviceRescueTest-1093973425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e43f609e3244c25bc951e870d50e639',uuid=3b54f114-2b97-4b0b-9149-06347861d653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converting VIF {"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG os_vif [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caebaec1-1d70-561a-8d01-8d40a1f3b8ff', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8997ab3d-23, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8997ab3d-23, col_values=(('qos', UUID('b922f948-6ee8-44cb-9640-60104d1ad60c')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8997ab3d-23, col_values=(('external_ids', {'iface-id': '8997ab3d-23ec-4b9b-8743-8269f35eb4a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:33:4c', 'vm-uuid': '3b54f114-2b97-4b0b-9149-06347861d653'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:06 user nova-compute[86931]: INFO os_vif [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23')
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No VIF found with MAC fa:16:3e:96:33:4c, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updated VIF entry in instance network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be09a1b9-5d3d-4730-80c5-c266f3d5e837 req-73be8827-db61-4821-912c-73eeab8c559c service nova] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:07 user nova-compute[86931]: INFO nova.compute.manager [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Terminating instance
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:26:07 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Creating image(s)
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Ensure instance console log exists: /opt/stack/data/nova/instances/e77e6736-2e09-4eb3-9738-eeaa26eac61b/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Start _get_guest_xml network_info=[{"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '58548f3c-c24c-4b60-8389-6c01d15b04e5', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuQcUmBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e77e6736-2e09-4eb3-9738-eeaa26eac61b', 'attached_at': '', 'detached_at': '', 'volume_id': '67585947-db8e-425e-a0fb-5fd812a8a95a', 'serial': '67585947-db8e-425e-a0fb-5fd812a8a95a'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:07 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuQcUmBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:26:07 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:26:07 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:26:07 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[312cd97e-859c-4767-890e-c74e9caf713e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:26:07 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1e447-dc62-4efa-8516-2ff7cdd25df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a] added
Nov 16 19:26:07 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d80c143-06dc-43cf-8c9b-f2ed0cc1f168]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4365397-ef75-4c44-95c7-2a3dc0e54552]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuQcUmBI {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuQcUmBI" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e0e217-e65a-4023-97fb-9c2ac6d036f8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuQcUmBI'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec6483-de85-400a-b2ad-1e56020b3807]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd6d1f8-f0ee-4ddf-93c2-673b42077c45]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:07 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:26:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[124947ab-186c-4def-8d7d-65ee0ae40858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260]
Nov 16 19:26:08 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260] successful.
Nov 16 19:26:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e3afc-3e36-4afc-84d7-beb2b9bcee22]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:08 user nova-compute[86931]: WARNING nova.compute.manager [req-9be1b99e-29ef-4895-bb5e-f389d40e2013 req-cd858d89-0d5c-4dd7-afe3-efb0dcf17f48 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state building and task_state spawning.
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] No waiting events found dispatching network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:08 user nova-compute[86931]: WARNING nova.compute.manager [req-bef6ee23-5351-447a-92e7-bf492453250a req-ed9c4058-65aa-4252-baec-b3558c5a81fd service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received unexpected event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 for instance with vm_state active and task_state None.
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3382c709-adf1-4b28-a46e-d48badc0bfb5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:08 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-unplugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Acquiring lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] No waiting events found dispatching network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:08 user nova-compute[86931]: WARNING nova.compute.manager [req-f2dd3c57-56b5-41dc-a388-4e67b488d3b5 req-5b5a63c7-6ac1-47e7-86a0-47ccf0e63393 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received unexpected event network-vif-plugged-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 for instance with vm_state active and task_state deleting.
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e43cf4-5af6-48a4-ae53-c97f86ce87ae]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuQcUmBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Instance destroyed successfully.
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lazy-loading 'resources' on Instance uuid e6311dce-9836-41b2-bfc2-c65262aa3012 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-488420017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-574938806',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6zF5yyMUyNYW/BsKlWwcmzYy+E451EupR8un2yaWU/CMDBGDiUltFj0RP1kx4k7DOS+9SYJeLfPPCSswQEgxCqC3kEdatlxJBM0kovKuWwzTM+iaUvKagMDUrgYrppUQ==',key_name='tempest-keypair-38684584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2255f38550244b2a37369cd6723f44a',ramdisk_id='',reservation_id='r-xpzwy6sq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-649419166',owner_user_name='tempest-ServerActionsV293TestJSON-649419166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bd27ea76994ab5937a32f4d1ecc806',uuid=e6311dce-9836-41b2-bfc2-c65262aa3012,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converting VIF {"id": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "address": "fa:16:3e:29:ff:97", "network": {"id": "efaa8728-74f6-44a8-a64b-5524de788408", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1666635111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2255f38550244b2a37369cd6723f44a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8f88f6-9a", "ovs_interfaceid": "8c8f88f6-9aea-4745-ab36-1bae32a5fd44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_vif [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8f88f6-9a, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a567b20e-1a05-4c78-81ad-2aaa2530ff81) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:08 user nova-compute[86931]: INFO os_vif [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:ff:97,bridge_name='br-int',has_traffic_filtering=True,id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44,network=Network(efaa8728-74f6-44a8-a64b-5524de788408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8f88f6-9a')
Nov 16 19:26:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKCHEJVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:26:08 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:26:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26132366639356337', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132366639356337', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.511s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce90d1-f34f-4663-bcfe-e8a38a773b8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:26:09 user nova-compute[86931]: No targets found.
Nov 16 19:26:09 user nova-compute[86931]: iSNS:
Nov 16 19:26:09 user nova-compute[86931]: No targets found.
Nov 16 19:26:09 user nova-compute[86931]: STATIC:
Nov 16 19:26:09 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5
Nov 16 19:26:09 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:26:09 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:26:09 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:26:09 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:26:09 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:26:09 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:26:09 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:26:09 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:26:09 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a
Nov 16 19:26:09 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:26:09 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:26:09 user nova-compute[86931]: FIRMWARE:
Nov 16 19:26:09 user nova-compute[86931]: No targets found.
Nov 16 19:26:09 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:26:09 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:26:09 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1771152324',display_name='tempest-TestVolumeBootPattern-server-1771152324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1771152324',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-nzvos1ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:56Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=e77e6736-2e09-4eb3-9738-eeaa26eac61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.objects.instance [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid e77e6736-2e09-4eb3-9738-eeaa26eac61b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:26:09 user nova-compute[86931]:   <uuid>e77e6736-2e09-4eb3-9738-eeaa26eac61b</uuid>
Nov 16 19:26:09 user nova-compute[86931]:   <name>instance-0000000f</name>
Nov 16 19:26:09 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:26:09 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:26:09 user nova-compute[86931]:   <metadata>
Nov 16 19:26:09 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:26:09 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:26:09 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-server-1771152324</nova:name>
Nov 16 19:26:09 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:26:07</nova:creationTime>
Nov 16 19:26:09 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:26:09 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:26:09 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:26:09 user nova-compute[86931]:       <nova:owner>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:26:09 user nova-compute[86931]:       </nova:owner>
Nov 16 19:26:09 user nova-compute[86931]:       <nova:ports>
Nov 16 19:26:09 user nova-compute[86931]:         <nova:port uuid="7692f2fb-3168-44ff-b25c-7a90225dc2e7">
Nov 16 19:26:09 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 19:26:09 user nova-compute[86931]:         </nova:port>
Nov 16 19:26:09 user nova-compute[86931]:       </nova:ports>
Nov 16 19:26:09 user nova-compute[86931]:     </nova:instance>
Nov 16 19:26:09 user nova-compute[86931]:   </metadata>
Nov 16 19:26:09 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:26:09 user nova-compute[86931]:     <system>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="serial">e77e6736-2e09-4eb3-9738-eeaa26eac61b</entry>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="uuid">e77e6736-2e09-4eb3-9738-eeaa26eac61b</entry>
Nov 16 19:26:09 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:26:09 user nova-compute[86931]:     </system>
Nov 16 19:26:09 user nova-compute[86931]:   </sysinfo>
Nov 16 19:26:09 user nova-compute[86931]:   <os>
Nov 16 19:26:09 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:26:09 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:26:09 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:26:09 user nova-compute[86931]:   </os>
Nov 16 19:26:09 user nova-compute[86931]:   <features>
Nov 16 19:26:09 user nova-compute[86931]:     <acpi/>
Nov 16 19:26:09 user nova-compute[86931]:     <apic/>
Nov 16 19:26:09 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:26:09 user nova-compute[86931]:   </features>
Nov 16 19:26:09 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:26:09 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:26:09 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:26:09 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:26:09 user nova-compute[86931]:   </clock>
Nov 16 19:26:09 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:26:09 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:26:09 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:26:09 user nova-compute[86931]:   </cpu>
Nov 16 19:26:09 user nova-compute[86931]:   <devices>
Nov 16 19:26:09 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:26:09 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:26:09 user nova-compute[86931]:       <source dev="/dev/sde"/>
Nov 16 19:26:09 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:26:09 user nova-compute[86931]:       <serial>67585947-db8e-425e-a0fb-5fd812a8a95a</serial>
Nov 16 19:26:09 user nova-compute[86931]:     </disk>
Nov 16 19:26:09 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:26:09 user nova-compute[86931]:       <mac address="fa:16:3e:d2:85:fa"/>
Nov 16 19:26:09 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:09 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:26:09 user nova-compute[86931]:       <target dev="tap7692f2fb-31"/>
Nov 16 19:26:09 user nova-compute[86931]:     </interface>
Nov 16 19:26:09 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:26:09 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/e77e6736-2e09-4eb3-9738-eeaa26eac61b/console.log" append="off"/>
Nov 16 19:26:09 user nova-compute[86931]:     </serial>
Nov 16 19:26:09 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:26:09 user nova-compute[86931]:     <video>
Nov 16 19:26:09 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:09 user nova-compute[86931]:     </video>
Nov 16 19:26:09 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:26:09 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:26:09 user nova-compute[86931]:     </rng>
Nov 16 19:26:09 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:26:09 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:26:09 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:26:09 user nova-compute[86931]:     </memballoon>
Nov 16 19:26:09 user nova-compute[86931]:   </devices>
Nov 16 19:26:09 user nova-compute[86931]: </domain>
Nov 16 19:26:09 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1771152324',display_name='tempest-TestVolumeBootPattern-server-1771152324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1771152324',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-nzvos1ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:56Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=e77e6736-2e09-4eb3-9738-eeaa26eac61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_vif [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[030fe8f8-1118-45b4-918b-2b66fc0e4f54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95e80161-8146-5ee0-aa43-1bbcf8b136e6', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7692f2fb-31, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7692f2fb-31, col_values=(('qos', UUID('fb2aa9b6-5db3-4f14-95e0-3b2c42b94796')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7692f2fb-31, col_values=(('external_ids', {'iface-id': '7692f2fb-3168-44ff-b25c-7a90225dc2e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:85:fa', 'vm-uuid': 'e77e6736-2e09-4eb3-9738-eeaa26eac61b'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:09 user nova-compute[86931]: INFO os_vif [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31')
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[75464c1a-c5fe-4585-a244-6c693530e357]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:09 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:09 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:09 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c7f4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f760c94-88b9-44d1-b3ee-4adb0ad89e66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[632f4c28-04c0-4633-a136-96327ea8111a]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:d2:85:fa, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e519a03-e951-4bba-bb3d-142a77629df4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76f1fd-6449-4100-8c3d-575764c2b814]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[279ab654-a1bf-4a9a-8e2b-d8b502ef8813]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8edd09-3a66-432d-8fb5-66289eccdc97]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260]
Nov 16 19:26:09 user nova-compute[86931]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5, portal: 172.16.0.220,3260] successful.
Nov 16 19:26:09 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b692075-47b9-49ff-931a-c612d8ff61a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a880317e-2712-4d30-a1de-7e92fd41e89b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] <== disconnect_volume: return (861ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:26:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deleting instance files /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012_del
Nov 16 19:26:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deletion of /opt/stack/data/nova/instances/e6311dce-9836-41b2-bfc2-c65262aa3012_del complete
Nov 16 19:26:09 user nova-compute[86931]: INFO nova.compute.manager [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Took 2.14 seconds to destroy the instance on the hypervisor.
Nov 16 19:26:09 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:26:09 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:10 user nova-compute[86931]: WARNING nova.compute.manager [req-b8dafb75-74e0-4994-b319-01e2f4075a9f req-4b7f34c3-6c9b-4ea2-bfdf-d359036f85e2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state building and task_state spawning.
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:10 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Took 0.65 seconds to deallocate network for instance.
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-fc3892db-f4eb-42a7-9582-d5cfbb953e3d req-3a3dc0b8-1f5f-40dd-a9ba-9703a1b01bc5 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Received event network-vif-deleted-8c8f88f6-9aea-4745-ab36-1bae32a5fd44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:10 user nova-compute[86931]: INFO nova.compute.manager [req-fc3892db-f4eb-42a7-9582-d5cfbb953e3d req-3a3dc0b8-1f5f-40dd-a9ba-9703a1b01bc5 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Neutron deleted interface 8c8f88f6-9aea-4745-ab36-1bae32a5fd44; detaching it from the instance and deleting it from the info cache
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-fc3892db-f4eb-42a7-9582-d5cfbb953e3d req-3a3dc0b8-1f5f-40dd-a9ba-9703a1b01bc5 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-fc3892db-f4eb-42a7-9582-d5cfbb953e3d req-3a3dc0b8-1f5f-40dd-a9ba-9703a1b01bc5 service nova] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Detach interface failed, port_id=8c8f88f6-9aea-4745-ab36-1bae32a5fd44, reason: Instance e6311dce-9836-41b2-bfc2-c65262aa3012 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:26:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance spawned successfully.
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:10 user nova-compute[86931]: INFO nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:26:10 user nova-compute[86931]: INFO nova.compute.manager [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Took 7.01 seconds to build instance.
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a0e7b513-ef3d-4524-98b1-09cedf144da3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.102s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] No waiting events found dispatching network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:10 user nova-compute[86931]: WARNING nova.compute.manager [req-a95bbf33-9f67-4157-a9df-60c820988425 req-51a57ef0-4b3f-4898-bae8-08aea68b63df service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received unexpected event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 for instance with vm_state building and task_state spawning.
Nov 16 19:26:11 user nova-compute[86931]: INFO nova.compute.manager [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Took 0.88 seconds to detach 1 volumes for instance.
Nov 16 19:26:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] [instance: e6311dce-9836-41b2-bfc2-c65262aa3012] Deleting volume: 0b692075-47b9-49ff-931a-c612d8ff61a5 {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:11 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Deleted allocations for instance e6311dce-9836-41b2-bfc2-c65262aa3012
Nov 16 19:26:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2a97190-cfbe-4b3c-beff-09ed806613fe tempest-ServerActionsV293TestJSON-649419166 tempest-ServerActionsV293TestJSON-649419166-project-member] Lock "e6311dce-9836-41b2-bfc2-c65262aa3012" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.474s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] No waiting events found dispatching network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:12 user nova-compute[86931]: WARNING nova.compute.manager [req-c703d830-6482-4dee-95fb-12f9bf2dd19a req-f5ac9402-d951-448e-ac85-efbba8a0b70c service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received unexpected event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 for instance with vm_state building and task_state spawning.
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:26:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Instance spawned successfully.
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:26:13 user nova-compute[86931]: INFO nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 16 19:26:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:26:13 user nova-compute[86931]: INFO nova.compute.manager [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Took 18.11 seconds to build instance.
Nov 16 19:26:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-237574cd-54c8-4dde-89bf-3fe2619db0c2 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.218s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:37 user nova-compute[86931]: INFO nova.compute.manager [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Rescuing
Nov 16 19:26:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:37 user nova-compute[86931]: DEBUG nova.network.neutron [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:39 user nova-compute[86931]: WARNING nova.compute.manager [req-19d67bab-c364-4365-8f86-99ee8af51da2 req-e3d5a418-b435-42f0-b8f0-69a5d2cd762e service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state rescuing.
Nov 16 19:26:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance destroyed successfully.
Nov 16 19:26:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Attempting a stable device rescue
Nov 16 19:26:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:26:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Creating image(s)
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'trusted_certs' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.006s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 1.057s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:41 user nova-compute[86931]: WARNING nova.compute.manager [req-3ad0debb-76c4-46a1-98bc-9b03365c5c14 req-9a45183d-4e78-425a-a844-053681a5586a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state rescuing.
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.part --force-share --output=json" returned: 0 in 0.222s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.virt.images [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] 65b79bcb-ae9a-4955-8f31-58a2d6e9e1fd was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.part /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.part /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.converted" returned: 0 in 0.515s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.354s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8,backing_fmt=raw /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8,backing_fmt=raw /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue" returned: 0 in 0.060s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'migration_context' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<04ec3edd-f329-47d3-84df-85343c9b4336> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start _get_guest_xml network_info=[{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:7f:a2:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '65b79bcb-ae9a-4955-8f31-58a2d6e9e1fd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '7fd4ca2a-b9c6-4b64-aa80-70dc8dde0aaf', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '04ec3edd-f329-47d3-84df-85343c9b4336', 'attached_at': '', 'detached_at': '', 'volume_id': '58534ea8-5a28-42c9-ac38-8616c8402051', 'serial': '58534ea8-5a28-42c9-ac38-8616c8402051'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<04ec3edd-f329-47d3-84df-85343c9b4336> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'numa_topology' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<04ec3edd-f329-47d3-84df-85343c9b4336> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:26:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<04ec3edd-f329-47d3-84df-85343c9b4336> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:26:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:26:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:26:42 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d069c8-41a5-42d8-a0e4-57469dde774b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BzyOTjYq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 19:26:42 user nova-compute[86931]: node.name = iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:26:42 user nova-compute[86931]: node.tpgt = -1
Nov 16 19:26:42 user nova-compute[86931]: node.startup = automatic
Nov 16 19:26:42 user nova-compute[86931]: node.leading_login = No
Nov 16 19:26:42 user nova-compute[86931]: iface.iscsi_ifacename = default
Nov 16 19:26:42 user nova-compute[86931]: iface.net_ifacename = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.ipaddress = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.prefix_len = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.hwaddress = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.transport_name = tcp
Nov 16 19:26:42 user nova-compute[86931]: iface.initiatorname = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.vlan_id = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.vlan_priority = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.vlan_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.iface_num = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.mtu = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.port = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.bootproto = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.subnet_mask = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.gateway = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_alt_client_id = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_dns = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_learn_iqn = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_vendor_id_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_vendor_id = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.dhcp_slp_da = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.fragmentation = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.gratuitous_arp = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.incoming_forwarding = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.tos_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.tos = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.ttl = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.delayed_ack = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.tcp_nagle = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.tcp_wsf_state = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.tcp_wsf = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.tcp_timer_scale = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.tcp_timestamp = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.redirect = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.def_task_mgmt_timeout = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.header_digest = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.data_digest = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.immediate_data = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.initial_r2t = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.data_seq_inorder = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.data_pdu_inorder = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.erl = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.max_receive_data_len = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.first_burst_len = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.max_outstanding_r2t = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.max_burst_len = 0
Nov 16 19:26:42 user nova-compute[86931]: iface.chap_auth = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.bidi_chap = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.strict_login_compliance = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.discovery_auth = <empty>
Nov 16 19:26:42 user nova-compute[86931]: iface.discovery_logout = <empty>
Nov 16 19:26:42 user nova-compute[86931]: node.discovery_address = <empty>
Nov 16 19:26:42 user nova-compute[86931]: node.discovery_port = 0
Nov 16 19:26:42 user nova-compute[86931]: node.discovery_type = static
Nov 16 19:26:42 user nova-compute[86931]: node.session.initial_cmdsn = 0
Nov 16 19:26:42 user nova-compute[86931]: node.session.initial_login_retry_max = 8
Nov 16 19:26:42 user nova-compute[86931]: node.session.xmit_thread_priority = -20
Nov 16 19:26:42 user nova-compute[86931]: node.session.cmds_max = 128
Nov 16 19:26:42 user nova-compute[86931]: node.session.queue_depth = 32
Nov 16 19:26:42 user nova-compute[86931]: node.session.nr_sessions = 1
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.authmethod = CHAP
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.username = BzyOTjYq
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.password = ***
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.username_in = <empty>
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.password_in = <empty>
Nov 16 19:26:42 user nova-compute[86931]: node.session.auth.chap_algs = MD5
Nov 16 19:26:42 user nova-compute[86931]: node.session.timeo.replacement_timeout = 120
Nov 16 19:26:42 user nova-compute[86931]: node.session.err_timeo.abort_timeout = 15
Nov 16 19:26:42 user nova-compute[86931]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 19:26:42 user nova-compute[86931]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 19:26:42 user nova-compute[86931]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.FastAbort = Yes
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.InitialR2T = No
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.ImmediateData = Yes
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.MaxConnections = 1
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 19:26:42 user nova-compute[86931]: node.session.iscsi.ERL = 0
Nov 16 19:26:42 user nova-compute[86931]: node.session.scan = manual
Nov 16 19:26:42 user nova-compute[86931]: node.session.reopen_max = 0
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].address = 172.16.0.220
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].port = 3260
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].startup = manual
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].tcp.window_size = 524288
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].tcp.type_of_service = 0
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].timeo.logout_timeout = 15
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].timeo.login_timeout = 15
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].timeo.auth_timeout = 45
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.DataDigest = None
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.IFMarker = No
Nov 16 19:26:42 user nova-compute[86931]: node.conn[0].iscsi.OFMarker = No
Nov 16 19:26:42 user nova-compute[86931]: # END RECORD
Nov 16 19:26:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8339ce-6e35-42d5-84bd-2548048890b5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13fff08-c75f-459a-8955-7d8f76bd074b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzyOTjYq {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzyOTjYq" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa560d9-2ec0-48b1-b25a-43c93ddb86b5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzyOTjYq'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f4abbb-263e-4539-8b5d-9d1ce7dcd6c2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9867c-3f90-438f-a012-29394e9a8e4b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:26:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:26:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:26:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] HCTL ('33', '0', '0', 0) found on session 17 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[578efced-3f83-4c9f-8534-1dc9b6bf52fa]: (4, ('0 0 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching for a device in session 17 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.232s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== connect_volume: return (234ms) {'type': 'block', 'scsi_wwn': '26237373766316338', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237373766316338', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-39047473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-39047473',id=12,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:25:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-j1i0hpw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:25:05Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=04ec3edd-f329-47d3-84df-85343c9b4336,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:7f:a2:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:7f:a2:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.objects.base [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<04ec3edd-f329-47d3-84df-85343c9b4336> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:26:42 user nova-compute[86931]:   <uuid>04ec3edd-f329-47d3-84df-85343c9b4336</uuid>
Nov 16 19:26:42 user nova-compute[86931]:   <name>instance-0000000c</name>
Nov 16 19:26:42 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:26:42 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:26:42 user nova-compute[86931]:   <metadata>
Nov 16 19:26:42 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:26:42 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-39047473</nova:name>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:26:42</nova:creationTime>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:26:42 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:26:42 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:owner>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:26:42 user nova-compute[86931]:       </nova:owner>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:26:42 user nova-compute[86931]:       <nova:ports>
Nov 16 19:26:42 user nova-compute[86931]:         <nova:port uuid="e07d532f-681d-4ea2-b9b3-88bc2e3acbeb">
Nov 16 19:26:42 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:26:42 user nova-compute[86931]:         </nova:port>
Nov 16 19:26:42 user nova-compute[86931]:       </nova:ports>
Nov 16 19:26:42 user nova-compute[86931]:     </nova:instance>
Nov 16 19:26:42 user nova-compute[86931]:   </metadata>
Nov 16 19:26:42 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:26:42 user nova-compute[86931]:     <system>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="serial">04ec3edd-f329-47d3-84df-85343c9b4336</entry>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="uuid">04ec3edd-f329-47d3-84df-85343c9b4336</entry>
Nov 16 19:26:42 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:26:42 user nova-compute[86931]:     </system>
Nov 16 19:26:42 user nova-compute[86931]:   </sysinfo>
Nov 16 19:26:42 user nova-compute[86931]:   <os>
Nov 16 19:26:42 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:26:42 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:26:42 user nova-compute[86931]:   </os>
Nov 16 19:26:42 user nova-compute[86931]:   <features>
Nov 16 19:26:42 user nova-compute[86931]:     <acpi/>
Nov 16 19:26:42 user nova-compute[86931]:     <apic/>
Nov 16 19:26:42 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:26:42 user nova-compute[86931]:   </features>
Nov 16 19:26:42 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:26:42 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:26:42 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:26:42 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:26:42 user nova-compute[86931]:   </clock>
Nov 16 19:26:42 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:26:42 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:26:42 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:26:42 user nova-compute[86931]:   </cpu>
Nov 16 19:26:42 user nova-compute[86931]:   <devices>
Nov 16 19:26:42 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:26:42 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:26:42 user nova-compute[86931]:       <source dev="/dev/sdb"/>
Nov 16 19:26:42 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:26:42 user nova-compute[86931]:       <serial>58534ea8-5a28-42c9-ac38-8616c8402051</serial>
Nov 16 19:26:42 user nova-compute[86931]:     </disk>
Nov 16 19:26:42 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:26:42 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:26:42 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue"/>
Nov 16 19:26:42 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:26:42 user nova-compute[86931]:       <boot order="1"/>
Nov 16 19:26:42 user nova-compute[86931]:     </disk>
Nov 16 19:26:42 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:26:42 user nova-compute[86931]:       <mac address="fa:16:3e:7f:a2:09"/>
Nov 16 19:26:42 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:42 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:26:42 user nova-compute[86931]:       <target dev="tape07d532f-68"/>
Nov 16 19:26:42 user nova-compute[86931]:     </interface>
Nov 16 19:26:42 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:26:42 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/console.log" append="off"/>
Nov 16 19:26:42 user nova-compute[86931]:     </serial>
Nov 16 19:26:42 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:26:42 user nova-compute[86931]:     <video>
Nov 16 19:26:42 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:42 user nova-compute[86931]:     </video>
Nov 16 19:26:42 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:26:42 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:26:42 user nova-compute[86931]:     </rng>
Nov 16 19:26:42 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:26:42 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:26:42 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:26:42 user nova-compute[86931]:     </memballoon>
Nov 16 19:26:42 user nova-compute[86931]:   </devices>
Nov 16 19:26:42 user nova-compute[86931]: </domain>
Nov 16 19:26:42 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:26:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance destroyed successfully.
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:7f:a2:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:26:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:47 user nova-compute[86931]: WARNING nova.compute.manager [req-d4ba3db6-1315-4a78-ba3d-b97dc53963fb req-6c1bf9eb-95a7-4e52-8b26-194e9ac12efc service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state rescuing.
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:26:47 user nova-compute[86931]: WARNING nova.compute.manager [req-2bf5184e-4741-4733-a15c-4f36ca09439c req-302c5250-e3d0-428b-9b77-5145ef21beb2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state rescuing.
Nov 16 19:26:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-90948c49-ed43-4c14-9add-3b8a42744cda tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:26:47 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:47 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.499256134033203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance fda35273-3799-4e6c-9170-4cc8779d9b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e77e6736-2e09-4eb3-9738-eeaa26eac61b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:26:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "fda35273-3799-4e6c-9170-4cc8779d9b37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:49 user nova-compute[86931]: INFO nova.compute.manager [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Terminating instance
Nov 16 19:26:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:26:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Instance destroyed successfully.
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'resources' on Instance uuid fda35273-3799-4e6c-9170-4cc8779d9b37 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1732015906',display_name='tempest-VolumesAdminNegativeTest-server-1732015906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1732015906',id=13,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-hquol1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:25:01Z,user_data=None,user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=fda35273-3799-4e6c-9170-4cc8779d9b37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a171861c-b367-45f0-927d-6c7ca68c0e44", "address": "fa:16:3e:58:05:c6", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa171861c-b3", "ovs_interfaceid": "a171861c-b367-45f0-927d-6c7ca68c0e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG os_vif [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa171861c-b3, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6624010b-51a0-4f42-a694-eab2fe462aec) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:50 user nova-compute[86931]: INFO os_vif [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=a171861c-b367-45f0-927d-6c7ca68c0e44,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa171861c-b3')
Nov 16 19:26:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Deleting instance files /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37_del
Nov 16 19:26:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Deletion of /opt/stack/data/nova/instances/fda35273-3799-4e6c-9170-4cc8779d9b37_del complete
Nov 16 19:26:50 user nova-compute[86931]: INFO nova.compute.manager [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 16 19:26:50 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:51 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Took 1.18 seconds to deallocate network for instance.
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating instance_info_cache with network_info: [{"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-e16458c7-133e-4424-bc89-018f28f6a546" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a4c7c2b-497d-4101-9105-767a3f194c3c req-824b1c3a-9803-477d-9ba0-69479bf43170 service nova] [instance: fda35273-3799-4e6c-9170-4cc8779d9b37] Received event network-vif-deleted-a171861c-b367-45f0-927d-6c7ca68c0e44 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:51 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Deleted allocations for instance fda35273-3799-4e6c-9170-4cc8779d9b37
Nov 16 19:26:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e674c6e3-9747-4f38-a39a-5eb51aedaae3 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "fda35273-3799-4e6c-9170-4cc8779d9b37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.853s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:26:56 user nova-compute[86931]: INFO nova.compute.claims [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Claim successful on node user
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:26:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.policy [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a76c0f9be3748ab9891d17446fb9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8cd8e208b65450bbf83ee548609db34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:26:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Creating image(s)
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.210s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk 1073741824" returned: 0 in 0.053s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Successfully created port: ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Cannot resize image /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Ensure instance console log exists: /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:26:58 user nova-compute[86931]: INFO nova.compute.claims [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Claim successful on node user
Nov 16 19:26:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Successfully updated port: ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-changed-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Refreshing instance network info cache due to event network-changed-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:26:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance network_info: |[{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Refreshing network info cache for port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start _get_guest_xml network_info=[{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:26:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:59 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:26:59 user nova-compute[86931]: INFO nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Booting with volume 27f432d4-68c6-4f34-9a77-e08f0074630a at /dev/vda
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.objects.instance [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.policy [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce22181da8c0413783af4a8e80af3366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2afbf3678823422f977441f3e0439376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:26:59 user nova-compute[86931]:   <uuid>4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</uuid>
Nov 16 19:26:59 user nova-compute[86931]:   <name>instance-00000012</name>
Nov 16 19:26:59 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:26:59 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:26:59 user nova-compute[86931]:   <metadata>
Nov 16 19:26:59 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:26:59 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherB-server-1168467223</nova:name>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:26:59</nova:creationTime>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:26:59 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:26:59 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:owner>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:user uuid="4a76c0f9be3748ab9891d17446fb9ee4">tempest-ServerActionsTestOtherB-1844657466-project-member</nova:user>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:project uuid="a8cd8e208b65450bbf83ee548609db34">tempest-ServerActionsTestOtherB-1844657466</nova:project>
Nov 16 19:26:59 user nova-compute[86931]:       </nova:owner>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:26:59 user nova-compute[86931]:       <nova:ports>
Nov 16 19:26:59 user nova-compute[86931]:         <nova:port uuid="ec0dd494-b4da-48ce-bfff-a77b0e3d2e69">
Nov 16 19:26:59 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:26:59 user nova-compute[86931]:         </nova:port>
Nov 16 19:26:59 user nova-compute[86931]:       </nova:ports>
Nov 16 19:26:59 user nova-compute[86931]:     </nova:instance>
Nov 16 19:26:59 user nova-compute[86931]:   </metadata>
Nov 16 19:26:59 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:26:59 user nova-compute[86931]:     <system>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="serial">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="uuid">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:26:59 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:26:59 user nova-compute[86931]:     </system>
Nov 16 19:26:59 user nova-compute[86931]:   </sysinfo>
Nov 16 19:26:59 user nova-compute[86931]:   <os>
Nov 16 19:26:59 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:26:59 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:26:59 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:26:59 user nova-compute[86931]:   </os>
Nov 16 19:26:59 user nova-compute[86931]:   <features>
Nov 16 19:26:59 user nova-compute[86931]:     <acpi/>
Nov 16 19:26:59 user nova-compute[86931]:     <apic/>
Nov 16 19:26:59 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:26:59 user nova-compute[86931]:   </features>
Nov 16 19:26:59 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:26:59 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:26:59 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:26:59 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:26:59 user nova-compute[86931]:   </clock>
Nov 16 19:26:59 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:26:59 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:26:59 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:26:59 user nova-compute[86931]:   </cpu>
Nov 16 19:26:59 user nova-compute[86931]:   <devices>
Nov 16 19:26:59 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:26:59 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:26:59 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk"/>
Nov 16 19:26:59 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:26:59 user nova-compute[86931]:     </disk>
Nov 16 19:26:59 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:26:59 user nova-compute[86931]:       <mac address="fa:16:3e:74:67:94"/>
Nov 16 19:26:59 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:59 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:26:59 user nova-compute[86931]:       <target dev="tapec0dd494-b4"/>
Nov 16 19:26:59 user nova-compute[86931]:     </interface>
Nov 16 19:26:59 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:26:59 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/console.log" append="off"/>
Nov 16 19:26:59 user nova-compute[86931]:     </serial>
Nov 16 19:26:59 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:26:59 user nova-compute[86931]:     <video>
Nov 16 19:26:59 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:26:59 user nova-compute[86931]:     </video>
Nov 16 19:26:59 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:26:59 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:26:59 user nova-compute[86931]:     </rng>
Nov 16 19:26:59 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:26:59 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:26:59 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:26:59 user nova-compute[86931]:     </memballoon>
Nov 16 19:26:59 user nova-compute[86931]:   </devices>
Nov 16 19:26:59 user nova-compute[86931]: </domain>
Nov 16 19:26:59 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_vif [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbac5be8-4db8-50ce-81d9-37d9ea182943', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec0dd494-b4, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec0dd494-b4, col_values=(('qos', UUID('a9f6ec01-4dcb-4060-b9d8-a6ca1131ab1a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec0dd494-b4, col_values=(('external_ids', {'iface-id': 'ec0dd494-b4da-48ce-bfff-a77b0e3d2e69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:67:94', 'vm-uuid': '4dfb53cd-4239-4cea-80d5-ecd6ac8ed200'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:26:59 user nova-compute[86931]: INFO os_vif [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cece90-9524-4389-81b5-66939c413e9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[42410dc4-efa7-4aea-80cf-e389815254fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No VIF found with MAC fa:16:3e:74:67:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400b555-ddc7-4e02-9941-6e476bde8ba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4bcf28-0c5b-4b0c-a9e5-99ad9adfe423]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:26:59 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:26:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ede3b3-99f3-4372-8541-79c9ba131cfa]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:26:59 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating existing volume attachment record: 0382cae7-f431-4d11-93c7-e496e9a5f09b {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:27:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updated VIF entry in instance network info cache for port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:27:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1e893435-0a36-4f69-9142-d18c59f9890e req-b962683d-7e8c-4a87-9a87-52fe44df0cae service nova] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:00 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully created port: 9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:01 user nova-compute[86931]: WARNING nova.compute.manager [req-3c29513b-d16a-4f8c-a300-313aa3691097 req-a86069cb-8bf0-4aa9-947c-38d179c195be service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state building and task_state spawning.
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully created port: dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:02 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully created port: 324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:02 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully created port: 921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully created port: 94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:03 user nova-compute[86931]: WARNING nova.compute.manager [req-c19974bf-3b08-430f-9e76-f67d3bf212bb req-4b94c2db-3d02-49bd-b33b-c398262645ed service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state building and task_state spawning.
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:27:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance spawned successfully.
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:03 user nova-compute[86931]: INFO nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 16 19:27:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:03 user nova-compute[86931]: INFO nova.compute.manager [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Took 7.07 seconds to build instance.
Nov 16 19:27:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-aa781015-0268-4f52-bfec-5ff17e411b0a tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.287s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: 9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-9a6589da-cb11-4832-94f1-8645c12e1920. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.network.neutron [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.network.neutron [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG nova.network.neutron [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6847d147-d2a8-442c-8e55-7f7637541440 req-de552dc7-0337-4b9f-acce-dd7222f963c7 service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:05 user nova-compute[86931]: INFO nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Booting with volume d6fde861-1347-47a6-97db-f9d8e0d6db84 at /dev/vdb
Nov 16 19:27:05 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[657dda1e-33f1-45ac-88ad-57dc18fb01ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e54c344-41a9-46c4-8ab4-28db529d7229]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbba29f-f3a0-4fe3-9c32-e1957014d1f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e97176-2d3a-4018-9773-4659dc98744e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:27:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:06 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:27:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[612224eb-2202-478f-92ea-c187388d6575]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating existing volume attachment record: a0a3aaae-9065-4b99-b9f5-049e78cedb3b {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: 465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-465b6ee0-ad82-425f-bbab-f2d6f5644afe. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7bfc64dc-cc8e-4141-b416-de2f6475659d req-68b6e78d-afc9-49f5-9414-3fed79d76050 service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: 324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: 921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-dccdd57b-9360-445e-b63a-8b8f656f4200. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-921c358a-170e-4284-8e63-b2813df6b741. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Successfully updated port: 94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7f2d22bd-823a-4734-8c0b-ff71e988e2b1 req-1aa82e2a-b2b1-44e3-88d1-628bccc0607a service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-94499965-10f9-4269-96d1-f92df474fc8c. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:11 user nova-compute[86931]: INFO nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Booting with volume 52971909-37cc-4721-a2dd-b0ffbf428e9e at /dev/vdc
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7f139f-05a3-4a5c-80b6-57bd1fd2b7f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd8b4d-1cc9-42e0-b481-bbc6f0c3fa41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbffd30-d6a9-4c86-be2f-f9cc3c939c58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d9fdb0-8e6c-4cfe-b5a6-739393b127db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:11 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:27:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[796b67c1-b7d9-40c6-9f03-43f2bc7a5ae4]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:11 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating existing volume attachment record: e23e32c1-f5ac-43ee-84db-a2685fefabca {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance network_info: |[{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG nova.network.neutron [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG nova.network.neutron [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updated VIF entry in instance network info cache for port 94499965-10f9-4269-96d1-f92df474fc8c. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG nova.network.neutron [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-254bcafc-7d07-475c-9ce4-d5a346f61478 req-1209cb96-6d3d-4c3a-81bc-cdcf9c4a4429 service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:27:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Creating image(s)
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Start _get_guest_xml network_info=[{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0382cae7-f431-4d11-93c7-e496e9a5f09b', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqVmPZWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2272a10b-5440-4635-88d1-3d3cac6d3cf9', 'attached_at': '', 'detached_at': '', 'volume_id': '27f432d4-68c6-4f34-9a77-e08f0074630a', 'serial': '27f432d4-68c6-4f34-9a77-e08f0074630a'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a0a3aaae-9065-4b99-b9f5-049e78cedb3b', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpKIymuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2272a10b-5440-4635-88d1-3d3cac6d3cf9', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6fde861-1347-47a6-97db-f9d8e0d6db84', 'serial': 'd6fde861-1347-47a6-97db-f9d8e0d6db84'}, 'boot_index': 1, 'mount_device': '/dev/vdb', 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'e23e32c1-f5ac-43ee-84db-a2685fefabca', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrePhsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2272a10b-5440-4635-88d1-3d3cac6d3cf9', 'attached_at': '', 'detached_at': '', 'volume_id': '52971909-37cc-4721-a2dd-b0ffbf428e9e', 'serial': '52971909-37cc-4721-a2dd-b0ffbf428e9e'}, 'boot_index': 2, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:27:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqVmPZWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:17 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fbbca-a9e1-4532-aa76-a511251bbfc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:27:17 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[017df1d8-f151-486e-b685-310379c0549b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a] added
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[910faf18-8e2e-4438-b6f7-a26e1ed1f7b5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d706a8ba-391d-4d3b-9dae-d353a907e9c3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqVmPZWh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqVmPZWh" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ba0ff-b862-4e7e-9f58-814c964d6304]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gqVmPZWh'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba37c79-fc03-4969-9f0d-4eb7d2a6aace]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f472ee-6cab-4169-9da8-408624d73c41]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f049e-a5f2-4ac4-90f1-4687d259c62f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260]
Nov 16 19:27:18 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd87c40-3532-48b8-9be4-17ee7fbebeb6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1798dc1-f8c8-44a1-972c-f8477156cf44]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb1e18b-ba3a-45e0-99ff-5bb2bdad0211]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:27:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqVmPZWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23161643263333030', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643263333030', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpKIymuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:19 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:19 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:19 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006f36e-f1d2-4e88-ac21-a1e600bd99e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:27:19 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.146s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1c67c9-80b1-4ed1-b042-6a842df0d456]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84] added
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a04df7-e261-4813-8988-d1031097ccfa]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ac584-80da-484b-a4cf-af08cc7e7d04]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpKIymuR {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NpKIymuR" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334fb5e-6a0d-47cd-82ba-ba5acdd5db16]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NpKIymuR'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b7d5bd-62be-4657-a778-99ee827bd71e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[974299ed-cd9f-40b5-9ccd-d7506a6f06b6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14aa910-7e97-44c3-aa8a-aa9f85b6fe8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260]
Nov 16 19:27:19 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e09a3df-a3e1-4c6a-b104-f88e2d954bc7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4539a5a9-6392-4759-9510-ac87cd2be640]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:19 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db55782-246b-4cea-8929-4f88f64063cd]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:27:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpKIymuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23262633561383234', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262633561383234', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrePhsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:20 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:20 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:20 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fadfab-be68-4c5a-8f59-dc226712c2c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:27:20 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90455a93-da6b-43b2-a167-e7b1c3ece3ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e] added
Nov 16 19:27:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c5c87a-7eca-4a65-a9b8-db693809d5e2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[959d5ae3-bd1d-44fa-9432-3ee759282e3c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrePhsga {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrePhsga" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5e41f8-4e6e-4841-8e51-9930762bc297]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrePhsga'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e27fc-e7ca-421a-9532-dfe3ce321474]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359438a-1735-481d-b108-01a5d44bb804]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bb7dc8-b920-41a7-9f99-3671bc12b668]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260]
Nov 16 19:27:21 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf83f8e4-f1f2-4741-b8be-f0559f3cbd3f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0785f-8492-44ef-9bee-dd1a6ff7457c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:21 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[11430b11-9896-4eff-98bf-9b940076e1e6]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrePhsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:27:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23030333637383863', 'path': '/dev/sdg'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333637383863', 'path': '/dev/sdg'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lazy-loading 'pci_devices' on Instance uuid 2272a10b-5440-4635-88d1-3d3cac6d3cf9 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:27:22 user nova-compute[86931]:   <uuid>2272a10b-5440-4635-88d1-3d3cac6d3cf9</uuid>
Nov 16 19:27:22 user nova-compute[86931]:   <name>instance-00000013</name>
Nov 16 19:27:22 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:27:22 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:27:22 user nova-compute[86931]:   <metadata>
Nov 16 19:27:22 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:27:22 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:name>tempest-device-tagging-server-2074577568</nova:name>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:27:17</nova:creationTime>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:27:22 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:27:22 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:owner>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:user uuid="ce22181da8c0413783af4a8e80af3366">tempest-TaggedBootDevicesTest-1988088176-project-member</nova:user>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:project uuid="2afbf3678823422f977441f3e0439376">tempest-TaggedBootDevicesTest-1988088176</nova:project>
Nov 16 19:27:22 user nova-compute[86931]:       </nova:owner>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:27:22 user nova-compute[86931]:       <nova:ports>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="9a6589da-cb11-4832-94f1-8645c12e1920">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="465b6ee0-ad82-425f-bbab-f2d6f5644afe">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="dccdd57b-9360-445e-b63a-8b8f656f4200">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="324bbe65-fcf9-4edd-aa32-9d0a02dd77ea">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="921c358a-170e-4284-8e63-b2813df6b741">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:         <nova:port uuid="94499965-10f9-4269-96d1-f92df474fc8c">
Nov 16 19:27:22 user nova-compute[86931]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 19:27:22 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:22 user nova-compute[86931]:       </nova:ports>
Nov 16 19:27:22 user nova-compute[86931]:     </nova:instance>
Nov 16 19:27:22 user nova-compute[86931]:   </metadata>
Nov 16 19:27:22 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:27:22 user nova-compute[86931]:     <system>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="serial">2272a10b-5440-4635-88d1-3d3cac6d3cf9</entry>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="uuid">2272a10b-5440-4635-88d1-3d3cac6d3cf9</entry>
Nov 16 19:27:22 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:27:22 user nova-compute[86931]:     </system>
Nov 16 19:27:22 user nova-compute[86931]:   </sysinfo>
Nov 16 19:27:22 user nova-compute[86931]:   <os>
Nov 16 19:27:22 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:27:22 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:27:22 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:27:22 user nova-compute[86931]:   </os>
Nov 16 19:27:22 user nova-compute[86931]:   <features>
Nov 16 19:27:22 user nova-compute[86931]:     <acpi/>
Nov 16 19:27:22 user nova-compute[86931]:     <apic/>
Nov 16 19:27:22 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:27:22 user nova-compute[86931]:   </features>
Nov 16 19:27:22 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:27:22 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:27:22 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:27:22 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:27:22 user nova-compute[86931]:   </clock>
Nov 16 19:27:22 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:27:22 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:27:22 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:27:22 user nova-compute[86931]:   </cpu>
Nov 16 19:27:22 user nova-compute[86931]:   <devices>
Nov 16 19:27:22 user nova-compute[86931]:     <disk type="file" device="cdrom">
Nov 16 19:27:22 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 19:27:22 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/disk.config"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="hda" bus="ide"/>
Nov 16 19:27:22 user nova-compute[86931]:     </disk>
Nov 16 19:27:22 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:27:22 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:22 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <serial>27f432d4-68c6-4f34-9a77-e08f0074630a</serial>
Nov 16 19:27:22 user nova-compute[86931]:     </disk>
Nov 16 19:27:22 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:27:22 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:22 user nova-compute[86931]:       <source dev="/dev/sdf"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <serial>d6fde861-1347-47a6-97db-f9d8e0d6db84</serial>
Nov 16 19:27:22 user nova-compute[86931]:     </disk>
Nov 16 19:27:22 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:27:22 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:22 user nova-compute[86931]:       <source dev="/dev/sdg"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="vdc" bus="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <serial>52971909-37cc-4721-a2dd-b0ffbf428e9e</serial>
Nov 16 19:27:22 user nova-compute[86931]:     </disk>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:d2:fc:a3"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tap9a6589da-cb"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:ec:20:2c"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tapab86aa53-dd"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:b7:a2:45"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tap465b6ee0-ad"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:6c:2e:18"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tapdccdd57b-93"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:3a:2c:15"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tap324bbe65-fc"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:27:1c:54"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tap921c358a-17"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:22 user nova-compute[86931]:       <mac address="fa:16:3e:c7:89:7d"/>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:22 user nova-compute[86931]:       <target dev="tap94499965-10"/>
Nov 16 19:27:22 user nova-compute[86931]:     </interface>
Nov 16 19:27:22 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:27:22 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/console.log" append="off"/>
Nov 16 19:27:22 user nova-compute[86931]:     </serial>
Nov 16 19:27:22 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:27:22 user nova-compute[86931]:     <video>
Nov 16 19:27:22 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:22 user nova-compute[86931]:     </video>
Nov 16 19:27:22 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:27:22 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:27:22 user nova-compute[86931]:     </rng>
Nov 16 19:27:22 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:27:22 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:27:22 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:27:22 user nova-compute[86931]:     </memballoon>
Nov 16 19:27:22 user nova-compute[86931]:   </devices>
Nov 16 19:27:22 user nova-compute[86931]: </domain>
Nov 16 19:27:22 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd44f5c1-0403-5f6a-95a6-b5e2b378b905', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a6589da-cb, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a6589da-cb, col_values=(('qos', UUID('e14275dc-7be3-4e99-aa08-7a41d90d39a7')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a6589da-cb, col_values=(('external_ids', {'iface-id': '9a6589da-cb11-4832-94f1-8645c12e1920', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:fc:a3', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68a9c44a-31f3-552b-bc61-8c129dd7339f', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab86aa53-dd, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab86aa53-dd, col_values=(('qos', UUID('4a6c83f8-e558-4db3-b628-50cb82d68ad5')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab86aa53-dd, col_values=(('external_ids', {'iface-id': 'ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:20:2c', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '495b9cf9-40f8-507e-874a-a90b9f67b8e5', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465b6ee0-ad, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap465b6ee0-ad, col_values=(('qos', UUID('989c4de0-48b1-4588-b2ee-d2cedefed2fd')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap465b6ee0-ad, col_values=(('external_ids', {'iface-id': '465b6ee0-ad82-425f-bbab-f2d6f5644afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:a2:45', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-changed-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Refreshing instance network info cache due to event network-changed-62d53c11-d15d-4af9-a560-8911e3dcaeb9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] Acquiring lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] Acquired lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Refreshing network info cache for port 62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a6ece6-fa3d-551a-b2b6-852357641b50', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdccdd57b-93, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdccdd57b-93, col_values=(('qos', UUID('4fd2a4f7-4c61-4976-937c-b780b0c2c20a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdccdd57b-93, col_values=(('external_ids', {'iface-id': 'dccdd57b-9360-445e-b63a-8b8f656f4200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:2e:18', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dc96583-34cd-5222-b867-65171743577c', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap324bbe65-fc, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap324bbe65-fc, col_values=(('qos', UUID('4b9f48aa-f4bf-4939-82ef-98ecb8d5ac3a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap324bbe65-fc, col_values=(('external_ids', {'iface-id': '324bbe65-fcf9-4edd-aa32-9d0a02dd77ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:2c:15', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61f3b98e-05ff-5e30-a83c-a7f3a7d8891e', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap921c358a-17, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap921c358a-17, col_values=(('qos', UUID('2a4385dd-2eb2-4b81-b90a-8fa686ac679d')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap921c358a-17, col_values=(('external_ids', {'iface-id': '921c358a-170e-4284-8e63-b2813df6b741', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:1c:54', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17')
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c75d840-91c0-5fa2-9e49-b29499f7228e', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94499965-10, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94499965-10, col_values=(('qos', UUID('b7f3e190-e255-441a-9b58-34079164d959')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94499965-10, col_values=(('external_ids', {'iface-id': '94499965-10f9-4269-96d1-f92df474fc8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:89:7d', 'vm-uuid': '2272a10b-5440-4635-88d1-3d3cac6d3cf9'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updated VIF entry in instance network info cache for port 62d53c11-d15d-4af9-a560-8911e3dcaeb9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating instance_info_cache with network_info: [{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3ba01a13-427e-4ab6-9ef9-096185ada997 req-63e6c1c6-8238-490b-b3c1-23bee77acbda service nova] Releasing lock "refresh_cache-3a3edd48-2e72-4195-a366-06ec5e34b496" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:22 user nova-compute[86931]: INFO os_vif [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10')
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] No BDM found with device name hda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] No VIF found with MAC fa:16:3e:d2:fc:a3, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] No VIF found with MAC fa:16:3e:3a:2c:15, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:27:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Using config drive
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.objects.instance [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'flavor' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Creating config drive at /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/disk.config
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3cefsxfw {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3cefsxfw" returned: 0 in 0.052s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:23 user nova-compute[86931]: INFO nova.compute.manager [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attaching volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 to /dev/vdb
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.utils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecbe8d5-5683-442d-a340-001dff17186a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[37991ec2-7b37-448e-bad3-a9174eb1bc40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f58068-50e4-4dc8-9baf-3a6c4e55f739]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a5066-985e-49d6-b5f8-ea64d0877aa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:23 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:27:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9f7e54-be06-4109-b090-836f2be126a8]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG os_brick.utils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:23 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating existing volume attachment record: 180792cb-ad17-414e-9557-92e1d1b1dc60 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:27:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:25 user nova-compute[86931]: WARNING nova.compute.manager [req-1cf380c0-74d1-445e-9992-bcbad8d52952 req-9888761b-3685-49ea-9304-44e58565a209 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 for instance with vm_state building and task_state spawning.
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:25 user nova-compute[86931]: WARNING nova.compute.manager [req-fea31e25-47e8-46a5-a001-d3753859b01b req-ed21f5c2-99a7-43ab-8b85-cfc07d01c473 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b for instance with vm_state building and task_state spawning.
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:26 user nova-compute[86931]: WARNING nova.compute.manager [req-ebdbd1ac-2bac-41b1-a39a-9c4402086abf req-42c633f8-f434-41a0-8044-5db7d6d6a811 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe for instance with vm_state building and task_state spawning.
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:27 user nova-compute[86931]: WARNING nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 for instance with vm_state building and task_state spawning.
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:27 user nova-compute[86931]: WARNING nova.compute.manager [req-cfcdc0a9-df4b-4356-9808-c15259fb8647 req-481451d5-4dcf-4231-9022-75d557db90b3 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c for instance with vm_state building and task_state spawning.
Nov 16 19:27:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:27 user nova-compute[86931]: WARNING nova.compute.manager [req-088e8e29-f546-46fa-8999-d9c23777ebfb req-50c6d15d-4af9-499c-bf05-e8ccca8554a2 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b for instance with vm_state building and task_state spawning.
Nov 16 19:27:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:28 user nova-compute[86931]: WARNING nova.compute.manager [req-8e264346-5c22-42bd-8185-bfa0d8d6c01a req-d754573b-0405-4335-b703-a28a7918a35e service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 for instance with vm_state building and task_state spawning.
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance spawned successfully.
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:29 user nova-compute[86931]: WARNING nova.compute.manager [req-0a0ddcb4-f733-45dd-8801-9278b4d41fb0 req-d46dcc59-df08-493e-8245-ff66b760daea service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c for instance with vm_state building and task_state spawning.
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Took 11.47 seconds to spawn the instance on the hypervisor.
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.compute.manager [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Took 30.85 seconds to build instance.
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-db02aa6e-5dc8-4d73-9342-098045125108 tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.971s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.compute.manager [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Detaching volume 98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:29 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:29 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:29 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.virt.block_device [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Attempting to driver detach volume 98febdf2-a358-42d4-803f-c936b5dd1100 from mountpoint /dev/vdb
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35183d-de17-4539-b64f-75be36150fa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:27:29 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffafe3b3-9234-484b-b84e-95c890c97c76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501] added
Nov 16 19:27:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fca1cc-7419-4948-bcbf-de656d1e1704]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa21da7a-f528-4646-a881-519f24f82176]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxJcTavX {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Attempting to detach device vdb from instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:27:29 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:29 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:27:29 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:27:29 user nova-compute[86931]:   <serial>98febdf2-a358-42d4-803f-c936b5dd1100</serial>
Nov 16 19:27:29 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:27:29 user nova-compute[86931]: </disk>
Nov 16 19:27:29 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:27:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdb from instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 from the persistent domain config.
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:27:29 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:29 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:27:29 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:27:29 user nova-compute[86931]:   <serial>98febdf2-a358-42d4-803f-c936b5dd1100</serial>
Nov 16 19:27:29 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:27:29 user nova-compute[86931]: </disk>
Nov 16 19:27:29 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxJcTavX" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66dbb59-b2cb-479e-a402-cf3742eba41e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxJcTavX'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f95210-7001-4071-9508-55f5f1593d60]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11cf67-34d4-4e13-84a2-8eb70b309f29]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:29 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5098452-46e1-4085-a1b7-5020e2555381]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]
Nov 16 19:27:29 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6349c-f804-459e-bf37-c4e90fd8bd28]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127b997-9ce6-4fcc-9f4e-2d261813b4dd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:30 user nova-compute[86931]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d1682-01f7-46c0-8730-d0cd3b0447c3]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:27:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26134346563316437', 'path': '/dev/sdh'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134346563316437', 'path': '/dev/sdh'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'flavor' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:27:31 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:31 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:27:31 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:27:31 user nova-compute[86931]:   <serial>ac40c1f1-9c78-4cc3-b65c-bfff18ca3501</serial>
Nov 16 19:27:31 user nova-compute[86931]: </disk>
Nov 16 19:27:31 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:4f:4c:61, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-609773ff-6d7e-4c9b-8241-c51b70c50a76 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.353s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:32 user nova-compute[86931]: INFO nova.compute.manager [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Rebuilding instance
Nov 16 19:27:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:33 user nova-compute[86931]: WARNING nova.compute.manager [req-5021b7fb-94f0-4126-b993-a3c751876dd2 req-4043b7b3-5824-4e07-ba92-6d506f323506 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state active and task_state rebuilding.
Nov 16 19:27:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:33 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance destroyed successfully.
Nov 16 19:27:33 user nova-compute[86931]: INFO nova.compute.manager [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Detaching volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:27:33 user nova-compute[86931]: INFO nova.virt.block_device [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attempting to driver detach volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 from mountpoint /dev/vdb
Nov 16 19:27:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Attempting to detach device vdb from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:27:33 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:33 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:27:33 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:27:33 user nova-compute[86931]:   <serial>ac40c1f1-9c78-4cc3-b65c-bfff18ca3501</serial>
Nov 16 19:27:33 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:27:33 user nova-compute[86931]: </disk>
Nov 16 19:27:33 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:27:33 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully detached device vdb from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the persistent domain config.
Nov 16 19:27:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:33 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[02791379-1dbb-4552-ae8b-80dc48c937e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:27:33 user nova-compute[86931]: No targets found.
Nov 16 19:27:33 user nova-compute[86931]: iSNS:
Nov 16 19:27:33 user nova-compute[86931]: No targets found.
Nov 16 19:27:33 user nova-compute[86931]: STATIC:
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a
Nov 16 19:27:33 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:33 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:33 user nova-compute[86931]: FIRMWARE:
Nov 16 19:27:33 user nova-compute[86931]: No targets found.
Nov 16 19:27:33 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:27:33 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:27:33 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df25d5f-6fed-4841-b51b-d90aa014d5fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bce607-6fd6-4f40-8210-aa4404936824]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:34 user nova-compute[86931]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5225f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501'): ({'sdh'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Removing single pathed devices sdh {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd0d620-4b62-47f1-9fae-b3fcbc0dc2b5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4183af-4df3-4c9b-99a5-44393fc4240f]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flushing IO for device /dev/sdh {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9640951b-9683-4730-9308-ca38690538ec]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.072s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[790cacae-2c11-43de-8bb4-f73dddcad77d]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ae960-1845-4a88-8e27-da959e7ee59a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753751f-4d92-4d49-97a7-a2bbf2296873]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]
Nov 16 19:27:34 user nova-compute[86931]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a43d70-08ea-40b9-b849-ddf30c3c9198]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== disconnect_volume: return (371ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:27:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance destroyed successfully.
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-ServerActionsTestOtherA-server-757406422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d53c11-d1, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e11eef2f-986a-44ec-beb8-a9091a36825c) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:35 user nova-compute[86931]: INFO os_vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1')
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:35 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6256cc-ce72-4e30-ad93-e20b71bbb10e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:35 user nova-compute[86931]: WARNING nova.compute.manager [req-ae8bad92-6ba2-4887-ba4e-ed1aed7662d1 req-98fc6d96-2b24-4cdd-b85d-75055bbe4750 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state active and task_state rebuilding.
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:27:35 user nova-compute[86931]: No targets found.
Nov 16 19:27:35 user nova-compute[86931]: iSNS:
Nov 16 19:27:35 user nova-compute[86931]: No targets found.
Nov 16 19:27:35 user nova-compute[86931]: STATIC:
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a
Nov 16 19:27:35 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:35 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:35 user nova-compute[86931]: FIRMWARE:
Nov 16 19:27:35 user nova-compute[86931]: No targets found.
Nov 16 19:27:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:27:35 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:27:35 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a4a5b-4fea-40ba-ba9b-eb2934fc3ef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[66012dc8-fb9e-4d03-805c-979f37647565]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:35 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61e4d0>, {}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Disconnecting from: [] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.113s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== disconnect_volume: return (115ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:27:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Deleting instance files /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496_del
Nov 16 19:27:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Deletion of /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496_del complete
Nov 16 19:27:35 user nova-compute[86931]: INFO nova.virt.block_device [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Booting with volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 at /dev/vdb
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.utils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e0ee6-acf1-4e89-ad6b-2f1f064e15ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb08e393-71ed-417b-abc6-e590f625ee78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11acfc1-59cb-4e7b-8660-a0f108ac71ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f131c28-da94-40b5-a0cb-a46537b3cd05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:27:35 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:27:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d26e7-7e2b-436f-b7c3-64b3c4fa8699]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG os_brick.utils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:35 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating existing volume attachment record: 1ff81a2e-bf24-4efc-916b-bbe684934c18 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:27:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:27:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:27:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:27:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Creating image(s)
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk 1073741824" returned: 0 in 0.051s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:27:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Cannot resize image /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Ensure instance console log exists: /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start _get_guest_xml network_info=[{"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '1ff81a2e-bf24-4efc-916b-bbe684934c18', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a3edd48-2e72-4195-a366-06ec5e34b496', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'serial': 'ac40c1f1-9c78-4cc3-b65c-bfff18ca3501'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:27:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 19:27:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:42 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce0ced-401a-43b6-a84a-764735c8ee3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:27:42 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ec9d0-29a9-4dbd-a9e7-a5f8f1750591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501] added
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c3f535-f287-4fb2-8815-ba512e8e72b0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aafe835-de86-470d-b445-dcfab9e91617]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxJcTavX {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxJcTavX" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6db4ac-53d8-42b4-994c-e743fb4e2bcf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxJcTavX'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cb5dc-55b2-4a11-91e9-9210a8dc6063]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b426dd-f3bc-409f-b26c-e0ca31976061]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d904e7-d8eb-4d26-b5de-8b369af97c8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]
Nov 16 19:27:42 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bbddde-0cbb-448f-be00-a9489fc38ce2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682d528-81a1-4fde-ab25-622a09392bab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:42 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca995d-8636-43e1-844b-e0006a5a7df2]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26134346563316437', 'path': '/dev/sdh'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134346563316437', 'path': '/dev/sdh'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:27:43 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:43 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=25.41230010986328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:43 user nova-compute[86931]: INFO nova.compute.manager [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Terminating instance
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-ServerActionsTestOtherA-server-757406422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:27:43 user nova-compute[86931]:   <uuid>3a3edd48-2e72-4195-a366-06ec5e34b496</uuid>
Nov 16 19:27:43 user nova-compute[86931]:   <name>instance-0000000e</name>
Nov 16 19:27:43 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:27:43 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:27:43 user nova-compute[86931]:   <metadata>
Nov 16 19:27:43 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:27:43 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherA-server-757406422</nova:name>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:27:42</nova:creationTime>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:27:43 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:27:43 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:owner>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:user uuid="c74086febf834740bbe6d094ebad864b">tempest-ServerActionsTestOtherA-672558396-project-member</nova:user>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:project uuid="823d93d9aed54ef0aac913d3707f207f">tempest-ServerActionsTestOtherA-672558396</nova:project>
Nov 16 19:27:43 user nova-compute[86931]:       </nova:owner>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:27:43 user nova-compute[86931]:       <nova:ports>
Nov 16 19:27:43 user nova-compute[86931]:         <nova:port uuid="62d53c11-d15d-4af9-a560-8911e3dcaeb9">
Nov 16 19:27:43 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 19:27:43 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:43 user nova-compute[86931]:       </nova:ports>
Nov 16 19:27:43 user nova-compute[86931]:     </nova:instance>
Nov 16 19:27:43 user nova-compute[86931]:   </metadata>
Nov 16 19:27:43 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:27:43 user nova-compute[86931]:     <system>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="serial">3a3edd48-2e72-4195-a366-06ec5e34b496</entry>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="uuid">3a3edd48-2e72-4195-a366-06ec5e34b496</entry>
Nov 16 19:27:43 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:27:43 user nova-compute[86931]:     </system>
Nov 16 19:27:43 user nova-compute[86931]:   </sysinfo>
Nov 16 19:27:43 user nova-compute[86931]:   <os>
Nov 16 19:27:43 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:27:43 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:27:43 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:27:43 user nova-compute[86931]:   </os>
Nov 16 19:27:43 user nova-compute[86931]:   <features>
Nov 16 19:27:43 user nova-compute[86931]:     <acpi/>
Nov 16 19:27:43 user nova-compute[86931]:     <apic/>
Nov 16 19:27:43 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:27:43 user nova-compute[86931]:   </features>
Nov 16 19:27:43 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:27:43 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:27:43 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:27:43 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:27:43 user nova-compute[86931]:   </clock>
Nov 16 19:27:43 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:27:43 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:27:43 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:27:43 user nova-compute[86931]:   </cpu>
Nov 16 19:27:43 user nova-compute[86931]:   <devices>
Nov 16 19:27:43 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:27:43 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:27:43 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk"/>
Nov 16 19:27:43 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:27:43 user nova-compute[86931]:     </disk>
Nov 16 19:27:43 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:27:43 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:27:43 user nova-compute[86931]:       <source dev="/dev/sdh"/>
Nov 16 19:27:43 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:27:43 user nova-compute[86931]:       <serial>ac40c1f1-9c78-4cc3-b65c-bfff18ca3501</serial>
Nov 16 19:27:43 user nova-compute[86931]:     </disk>
Nov 16 19:27:43 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:43 user nova-compute[86931]:       <mac address="fa:16:3e:4f:4c:61"/>
Nov 16 19:27:43 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:43 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:43 user nova-compute[86931]:       <target dev="tap62d53c11-d1"/>
Nov 16 19:27:43 user nova-compute[86931]:     </interface>
Nov 16 19:27:43 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:27:43 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/console.log" append="off"/>
Nov 16 19:27:43 user nova-compute[86931]:     </serial>
Nov 16 19:27:43 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:27:43 user nova-compute[86931]:     <video>
Nov 16 19:27:43 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:43 user nova-compute[86931]:     </video>
Nov 16 19:27:43 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:27:43 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:27:43 user nova-compute[86931]:     </rng>
Nov 16 19:27:43 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:27:43 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:27:43 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:27:43 user nova-compute[86931]:     </memballoon>
Nov 16 19:27:43 user nova-compute[86931]:   </devices>
Nov 16 19:27:43 user nova-compute[86931]: </domain>
Nov 16 19:27:43 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-ServerActionsTestOtherA-server-757406422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG os_vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8b39e6b-b99e-5024-bcdb-6dc788720584', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d53c11-d1, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62d53c11-d1, col_values=(('qos', UUID('9f51223a-ea00-4827-9199-85629586432c')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62d53c11-d1, col_values=(('external_ids', {'iface-id': '62d53c11-d15d-4af9-a560-8911e3dcaeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:4c:61', 'vm-uuid': '3a3edd48-2e72-4195-a366-06ec5e34b496'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: INFO os_vif [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1')
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:4f:4c:61, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-unplugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] No waiting events found dispatching network-vif-unplugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-08ab80f3-5b59-44ca-bbc0-29d1781039cb req-248f617e-96df-45b8-baef-fd0c9e9ec666 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-unplugged-a81af5e5-4748-4c34-887a-5988dfde05ab for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e16458c7-133e-4424-bc89-018f28f6a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e77e6736-2e09-4eb3-9738-eeaa26eac61b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 2272a10b-5440-4635-88d1-3d3cac6d3cf9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.879s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Instance destroyed successfully.
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lazy-loading 'resources' on Instance uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1560785364',display_name='tempest-VolumesAdminNegativeTest-server-1560785364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1560785364',id=5,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5G0zWBd4f373VyJJlEoeM+kAa8z/GU0lKdJeDfcajIgetPWnrz9IX+yNIxVRQx8duZkp5Ezjwx8A7Jzd93vl2VRf7DewA9sDPrC3bVIxE0oiyO/9BKD9kaYGvWLZ8SHw==',key_name='tempest-keypair-1373246192',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bf618b6c25f4e89b89d837f91df2063',ramdisk_id='',reservation_id='r-422qbe3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1956727884',owner_user_name='tempest-VolumesAdminNegativeTest-1956727884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='314dbeab5ae5441a813eebc5e6e24c98',uuid=e16458c7-133e-4424-bc89-018f28f6a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converting VIF {"id": "a81af5e5-4748-4c34-887a-5988dfde05ab", "address": "fa:16:3e:05:bf:bd", "network": {"id": "8364700a-4a79-4d7a-897a-047448f1177a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1929499025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bf618b6c25f4e89b89d837f91df2063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81af5e5-47", "ovs_interfaceid": "a81af5e5-4748-4c34-887a-5988dfde05ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG os_vif [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa81af5e5-47, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c904fbe-60fc-4da4-8d60-8d00ab19a9cb) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:44 user nova-compute[86931]: INFO os_vif [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:bf:bd,bridge_name='br-int',has_traffic_filtering=True,id=a81af5e5-4748-4c34-887a-5988dfde05ab,network=Network(8364700a-4a79-4d7a-897a-047448f1177a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81af5e5-47')
Nov 16 19:27:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Deleting instance files /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546_del
Nov 16 19:27:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Deletion of /opt/stack/data/nova/instances/e16458c7-133e-4424-bc89-018f28f6a546_del complete
Nov 16 19:27:45 user nova-compute[86931]: INFO nova.compute.manager [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:45 user nova-compute[86931]: WARNING nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 8d74eef2-f3a7-4063-95a5-4f13304c9d8f {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid afe35609-1004-4958-9893-d82894b6f297 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid e77e6736-2e09-4eb3-9738-eeaa26eac61b {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 9a367ef3-2818-4c3a-b891-5d222491cdde {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 2272a10b-5440-4635-88d1-3d3cac6d3cf9 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid e16458c7-133e-4424-bc89-018f28f6a546 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "afe35609-1004-4958-9893-d82894b6f297" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: INFO nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:45 user nova-compute[86931]: WARNING nova.compute.manager [req-f145c151-834a-4005-babd-5734c21b927e req-39f038d9-3b8b-4535-8b12-597584d6d1d9 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 19:27:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "afe35609-1004-4958-9893-d82894b6f297" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: INFO nova.compute.manager [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Terminating instance
Nov 16 19:27:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] Acquiring lock "e16458c7-133e-4424-bc89-018f28f6a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] Lock "e16458c7-133e-4424-bc89-018f28f6a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] No waiting events found dispatching network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:46 user nova-compute[86931]: WARNING nova.compute.manager [req-0796dd83-e529-49a5-bf4b-ed3af357df3e req-401aa03c-d8d8-46b4-87f9-af355672d074 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received unexpected event network-vif-plugged-a81af5e5-4748-4c34-887a-5988dfde05ab for instance with vm_state active and task_state deleting.
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Instance destroyed successfully.
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid e77e6736-2e09-4eb3-9738-eeaa26eac61b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Took 2.06 seconds to deallocate network for instance.
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1771152324',display_name='tempest-TestVolumeBootPattern-server-1771152324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1771152324',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:26:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-nzvos1ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:26:13Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=e77e6736-2e09-4eb3-9738-eeaa26eac61b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "address": "fa:16:3e:d2:85:fa", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7692f2fb-31", "ovs_interfaceid": "7692f2fb-3168-44ff-b25c-7a90225dc2e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_vif [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7692f2fb-31, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb2aa9b6-5db3-4f14-95e0-3b2c42b94796) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: INFO os_vif [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:85:fa,bridge_name='br-int',has_traffic_filtering=True,id=7692f2fb-3168-44ff-b25c-7a90225dc2e7,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7692f2fb-31')
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuQcUmBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:47 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c15e0ea-3558-4d70-834e-5710dd7810a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:27:47 user nova-compute[86931]: No targets found.
Nov 16 19:27:47 user nova-compute[86931]: iSNS:
Nov 16 19:27:47 user nova-compute[86931]: No targets found.
Nov 16 19:27:47 user nova-compute[86931]: STATIC:
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a
Nov 16 19:27:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:47 user nova-compute[86931]: FIRMWARE:
Nov 16 19:27:47 user nova-compute[86931]: No targets found.
Nov 16 19:27:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:27:47 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:27:47 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19f78fa-58a9-450b-924b-c0e2ab7ea3e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998f39d-c882-433c-82df-de84240f7bdf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:47 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c622b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36ba4b5-b808-4215-95f3-75b1f27010ce]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06332ae7-f904-40a8-be20-44811374b590]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7861af59-1a9f-4792-8202-7838b2a1144e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9ed0d-bfb7-47ce-8d28-ad26480b117b]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_91dc6f81', '/dev/disk/by-id/scsi-1SCST_BIO91dc6f81-a26f95c726eafcaf', '/dev/disk/by-id/scsi-26132366639356337') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:27:47 user nova-compute[86931]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_91dc6f81
Nov 16 19:27:47 user nova-compute[86931]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO91dc6f81-a26f95c726eafcaf
Nov 16 19:27:47 user nova-compute[86931]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26132366639356337
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab919f7-5cb8-4117-a198-78e3b2ceca54]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe3228-c522-4112-a657-9e5fa2973295]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ceacc6-a775-4560-a772-208d7e82a22f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260]
Nov 16 19:27:47 user nova-compute[86931]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67585947-db8e-425e-a0fb-5fd812a8a95a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4cfdc8-040c-4dc7-9992-bd9a651ae5b3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (479ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Deleting instance files /opt/stack/data/nova/instances/e77e6736-2e09-4eb3-9738-eeaa26eac61b_del
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Deletion of /opt/stack/data/nova/instances/e77e6736-2e09-4eb3-9738-eeaa26eac61b_del complete
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.compute.manager [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Deleted allocations for instance e16458c7-133e-4424-bc89-018f28f6a546
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d0f2c8b-e964-4034-9ad0-fc873a76b799 tempest-VolumesAdminNegativeTest-1956727884 tempest-VolumesAdminNegativeTest-1956727884-project-member] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.104s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e16458c7-133e-4424-bc89-018f28f6a546" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.887s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:47 user nova-compute[86931]: INFO nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e16458c7-133e-4424-bc89-018f28f6a546] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 19:27:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e16458c7-133e-4424-bc89-018f28f6a546" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.016s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:48 user nova-compute[86931]: WARNING nova.compute.manager [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-41b96f95-7df6-4172-be31-c30466f30185 req-b4a6df71-8a46-4d1d-b277-f57f74319199 service nova] [instance: e16458c7-133e-4424-bc89-018f28f6a546] Received event network-vif-deleted-a81af5e5-4748-4c34-887a-5988dfde05ab {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:27:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance spawned successfully.
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Took 0.62 seconds to deallocate network for instance.
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Trying to apply a migration context that does not seem to be set for this instance {{(pid=86931) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d5b5171d-c6a0-4a25-8af2-afedb4324530 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.088s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-unplugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] No waiting events found dispatching network-vif-unplugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-unplugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Acquiring lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] No waiting events found dispatching network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:48 user nova-compute[86931]: WARNING nova.compute.manager [req-24c1b7b1-ad16-4893-9ba3-98d95fbc5469 req-99063fa4-0669-42bc-a754-71c5a4ef3462 service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received unexpected event network-vif-plugged-7692f2fb-3168-44ff-b25c-7a90225dc2e7 for instance with vm_state active and task_state deleting.
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:48 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:27:48 user nova-compute[86931]: INFO nova.compute.claims [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Claim successful on node user
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:27:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.policy [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fed9425a174047c3b989c98682710c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50446b42a4644f398b94f86d0165d7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:27:49 user nova-compute[86931]: INFO nova.compute.manager [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Took 1.13 seconds to detach 1 volumes for instance.
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:27:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Creating image(s)
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "/opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "/opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Deleting volume: 67585947-db8e-425e-a0fb-5fd812a8a95a {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk 1073741824" returned: 0 in 0.065s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Successfully created port: 4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-eaef1ef6-6c1d-462e-8be6-06f6794a1698 req-cd1ada7e-fc08-4446-ba8d-1413dbfa07df service nova] [instance: e77e6736-2e09-4eb3-9738-eeaa26eac61b] Received event network-vif-deleted-7692f2fb-3168-44ff-b25c-7a90225dc2e7 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.254s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:50 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance e77e6736-2e09-4eb3-9738-eeaa26eac61b
Nov 16 19:27:50 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 is timed out.
Nov 16 19:27:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdb from instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 from the live domain config.
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYaHRvrq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:27:50 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5344f74a-eabd-4b9b-a579-cc4ef78d6a73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:27:50 user nova-compute[86931]: No targets found.
Nov 16 19:27:50 user nova-compute[86931]: iSNS:
Nov 16 19:27:50 user nova-compute[86931]: No targets found.
Nov 16 19:27:50 user nova-compute[86931]: STATIC:
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:27:50 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:27:50 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:27:50 user nova-compute[86931]: FIRMWARE:
Nov 16 19:27:50 user nova-compute[86931]: No targets found.
Nov 16 19:27:50 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:27:50 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:27:50 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca2910-7387-46c9-889e-f3bed27ae3b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[05866b20-2c8a-4c6a-9d7b-802a21fa6d19]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:27:50 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:27:50 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c655b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.100s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247d9a8-8068-4e30-91a0-062390a415d4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2520c2-7c85-44cd-969a-2bc76f921770]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json" returned: 0 in 0.435s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Cannot resize image /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Ensure instance console log exists: /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ed8f5-5e85-457d-816b-f79e9c6ba3ec]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-138c7744-fdf6-4c57-b0ba-ddd4cd631311 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "e77e6736-2e09-4eb3-9738-eeaa26eac61b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069d9ff-73ab-41bb-ad22-ad7b6bb37456]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1917668-1b7c-4122-8df2-d94cebbf930b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3667be-a7aa-48a5-b7c4-39c799c00414]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260]
Nov 16 19:27:50 user nova-compute[86931]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100, portal: 172.16.0.220,3260] successful.
Nov 16 19:27:50 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98febdf2-a358-42d4-803f-c936b5dd1100 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f5de16-d97f-4fae-a5f8-e1fd19f73100]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.546s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== disconnect_volume: return (548ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Successfully updated port: 4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquired lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Updating instance_info_cache with network_info: [{"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Releasing lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Instance network_info: |[{"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Start _get_guest_xml network_info=[{"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:27:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-350445119',display_name='tempest-ServersNegativeTestJSON-server-350445119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-350445119',id=20,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-c2gjvsx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:49Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=a3eb0784-f6eb-406b-9b04-acbf26eff8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.objects.instance [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lazy-loading 'pci_devices' on Instance uuid a3eb0784-f6eb-406b-9b04-acbf26eff8be {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:27:51 user nova-compute[86931]:   <uuid>a3eb0784-f6eb-406b-9b04-acbf26eff8be</uuid>
Nov 16 19:27:51 user nova-compute[86931]:   <name>instance-00000014</name>
Nov 16 19:27:51 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:27:51 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:27:51 user nova-compute[86931]:   <metadata>
Nov 16 19:27:51 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:27:51 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:name>tempest-ServersNegativeTestJSON-server-350445119</nova:name>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:27:51</nova:creationTime>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:27:51 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:27:51 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:owner>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:user uuid="fed9425a174047c3b989c98682710c46">tempest-ServersNegativeTestJSON-715001397-project-member</nova:user>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:project uuid="50446b42a4644f398b94f86d0165d7f8">tempest-ServersNegativeTestJSON-715001397</nova:project>
Nov 16 19:27:51 user nova-compute[86931]:       </nova:owner>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:27:51 user nova-compute[86931]:       <nova:ports>
Nov 16 19:27:51 user nova-compute[86931]:         <nova:port uuid="4d3a670d-4765-4455-bee7-960ce6a1015c">
Nov 16 19:27:51 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 19:27:51 user nova-compute[86931]:         </nova:port>
Nov 16 19:27:51 user nova-compute[86931]:       </nova:ports>
Nov 16 19:27:51 user nova-compute[86931]:     </nova:instance>
Nov 16 19:27:51 user nova-compute[86931]:   </metadata>
Nov 16 19:27:51 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:27:51 user nova-compute[86931]:     <system>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="serial">a3eb0784-f6eb-406b-9b04-acbf26eff8be</entry>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="uuid">a3eb0784-f6eb-406b-9b04-acbf26eff8be</entry>
Nov 16 19:27:51 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:27:51 user nova-compute[86931]:     </system>
Nov 16 19:27:51 user nova-compute[86931]:   </sysinfo>
Nov 16 19:27:51 user nova-compute[86931]:   <os>
Nov 16 19:27:51 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:27:51 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:27:51 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:27:51 user nova-compute[86931]:   </os>
Nov 16 19:27:51 user nova-compute[86931]:   <features>
Nov 16 19:27:51 user nova-compute[86931]:     <acpi/>
Nov 16 19:27:51 user nova-compute[86931]:     <apic/>
Nov 16 19:27:51 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:27:51 user nova-compute[86931]:   </features>
Nov 16 19:27:51 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:27:51 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:27:51 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:27:51 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:27:51 user nova-compute[86931]:   </clock>
Nov 16 19:27:51 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:27:51 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:27:51 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:27:51 user nova-compute[86931]:   </cpu>
Nov 16 19:27:51 user nova-compute[86931]:   <devices>
Nov 16 19:27:51 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:27:51 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:27:51 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk"/>
Nov 16 19:27:51 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:27:51 user nova-compute[86931]:     </disk>
Nov 16 19:27:51 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:27:51 user nova-compute[86931]:       <mac address="fa:16:3e:4c:8d:ab"/>
Nov 16 19:27:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:51 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:27:51 user nova-compute[86931]:       <target dev="tap4d3a670d-47"/>
Nov 16 19:27:51 user nova-compute[86931]:     </interface>
Nov 16 19:27:51 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:27:51 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/console.log" append="off"/>
Nov 16 19:27:51 user nova-compute[86931]:     </serial>
Nov 16 19:27:51 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:27:51 user nova-compute[86931]:     <video>
Nov 16 19:27:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:27:51 user nova-compute[86931]:     </video>
Nov 16 19:27:51 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:27:51 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:27:51 user nova-compute[86931]:     </rng>
Nov 16 19:27:51 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:27:51 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:27:51 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:27:51 user nova-compute[86931]:     </memballoon>
Nov 16 19:27:51 user nova-compute[86931]:   </devices>
Nov 16 19:27:51 user nova-compute[86931]: </domain>
Nov 16 19:27:51 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-350445119',display_name='tempest-ServersNegativeTestJSON-server-350445119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-350445119',id=20,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-c2gjvsx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:49Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=a3eb0784-f6eb-406b-9b04-acbf26eff8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG os_vif [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4db3dae8-b54c-5888-ba89-bd5fd648b637', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d3a670d-47, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d3a670d-47, col_values=(('qos', UUID('cec8e846-8c22-4a85-b019-62168a77ad71')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d3a670d-47, col_values=(('external_ids', {'iface-id': '4d3a670d-4765-4455-bee7-960ce6a1015c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:8d:ab', 'vm-uuid': 'a3eb0784-f6eb-406b-9b04-acbf26eff8be'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: INFO os_vif [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47')
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] No VIF found with MAC fa:16:3e:4c:8d:ab, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0954a317-77a5-45b1-9814-feded1137636 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.120s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.783s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-changed-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Refreshing instance network info cache due to event network-changed-4d3a670d-4765-4455-bee7-960ce6a1015c. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] Acquiring lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] Acquired lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Refreshing network info cache for port 4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=86931) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.objects.instance [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Updated VIF entry in instance network info cache for port 4d3a670d-4765-4455-bee7-960ce6a1015c. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Updating instance_info_cache with network_info: [{"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3194e006-3a99-4bf2-b900-0bce06d7afba req-5978644d-c363-45fb-a6e6-88904a024515 service nova] Releasing lock "refresh_cache-a3eb0784-f6eb-406b-9b04-acbf26eff8be" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:53 user nova-compute[86931]: WARNING nova.compute.manager [req-fe926585-80b8-491b-8187-db1d4f5bd091 req-89d1c68e-cc09-4c9d-86e2-b0b0cabdfef8 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state active and task_state powering-off.
Nov 16 19:27:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:53 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance destroyed successfully.
Nov 16 19:27:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4ee28af7-bb83-4f2a-9361-cfbb20a38d7a tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.233s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:55 user nova-compute[86931]: WARNING nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state None.
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] No waiting events found dispatching network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:55 user nova-compute[86931]: WARNING nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received unexpected event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c for instance with vm_state building and task_state spawning.
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] No waiting events found dispatching network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:27:55 user nova-compute[86931]: WARNING nova.compute.manager [req-fe9ec85f-d464-4d92-818e-e3fe6f424813 req-0f11d615-64c2-46b3-a88e-6abe4015874b service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received unexpected event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c for instance with vm_state building and task_state spawning.
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing instance network info cache due to event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:27:55 user nova-compute[86931]: DEBUG nova.network.neutron [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updated VIF entry in instance network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dd56ee85-6de7-4f79-86ca-f06be40e27a8 req-7b24654f-5e29-4699-84f6-ae2a08487374 service nova] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:27:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Instance spawned successfully.
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:56 user nova-compute[86931]: INFO nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Took 7.01 seconds to spawn the instance on the hypervisor.
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:27:56 user nova-compute[86931]: INFO nova.compute.manager [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Took 7.94 seconds to build instance.
Nov 16 19:27:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-97d8b69e-1fd7-498e-87ac-60ef11457178 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.051s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:27:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:27:56 user nova-compute[86931]: INFO nova.compute.manager [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] instance snapshotting
Nov 16 19:27:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Beginning live snapshot process
Nov 16 19:27:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb.delta 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:27:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb.delta 1073741824" returned: 0 in 0.063s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:27:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 19:27:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:27:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] COPY block job progress, current cursor: 48562176 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:27:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:27:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 19:27:59 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:27:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb.delta /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb.delta /opt/stack/data/nova/instances/snapshots/tmpd51tlj2p/1647cfddf93e441592d17fc205f1befb" returned: 0 in 0.538s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Snapshot extracted, beginning image upload
Nov 16 19:28:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Snapshot image upload complete
Nov 16 19:28:03 user nova-compute[86931]: INFO nova.compute.manager [None req-8f637db1-819d-421b-a48c-9ed9a570ec90 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Took 6.28 seconds to snapshot the instance on the hypervisor.
Nov 16 19:28:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:28 user nova-compute[86931]: INFO nova.compute.manager [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Unrescuing
Nov 16 19:28:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:28 user nova-compute[86931]: DEBUG nova.network.neutron [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG nova.objects.instance [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'flavor' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:29 user nova-compute[86931]: WARNING nova.compute.manager [req-fc454203-adbc-4cc8-b1b9-a8cb11e1f1cb req-dfd792f5-26d7-4031-9089-95679f49b79a service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:28:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance destroyed successfully.
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:31 user nova-compute[86931]: WARNING nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:28:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:31 user nova-compute[86931]: WARNING nova.compute.manager [req-218722a1-9556-4eff-abea-0140b93964e2 req-432c7124-d24b-4c2d-adf2-d8fbc8de9524 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:28:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-126db429-faa2-46f9-8f86-7e4cf8bfd061 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:28:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:33 user nova-compute[86931]: WARNING nova.compute.manager [req-d686f915-bdba-428a-a65f-cd96fc17c3ba req-fcfee296-c946-41ed-80a9-aff2a0e41837 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state None.
Nov 16 19:28:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:28:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:28:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:46 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:28:46 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.315685272216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 2272a10b-5440-4635-88d1-3d3cac6d3cf9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a3eb0784-f6eb-406b-9b04-acbf26eff8be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:28:47 user nova-compute[86931]: INFO nova.compute.claims [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Claim successful on node user
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-changed-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Refreshing instance network info cache due to event network-changed-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Refreshing network info cache for port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:28:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:28:48 user nova-compute[86931]: INFO nova.virt.block_device [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Booting with volume 7174d66e-4819-479a-977e-ab2fb2dc7efd at /dev/vda
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.policy [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.utils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eed8396-e64f-4c2d-bc31-eb8566d68ca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[84724223-084b-4388-a284-eab3d1192dda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b053187f-0fbc-479c-8e24-49e9b53ded86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f69f6-0146-4eed-9a0d-0a5652bda9ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:28:48 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8274615-c865-4dd2-ae7a-b5fb39b74d3d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG os_brick.utils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updating existing volume attachment record: 4bf268aa-e8ff-442e-941b-032c1beea94f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updated VIF entry in instance network info cache for port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3389b2cb-61d9-4304-897c-267c0bdf6576 req-14dcdd7b-3a2c-4798-a7b5-19295fcfcbdc service nova] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Successfully created port: 48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:28:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-changed-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing instance network info cache due to event network-changed-9a6589da-cb11-4832-94f1-8645c12e1920. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:28:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] Acquiring lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] Acquired lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Refreshing network info cache for port 9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Successfully updated port: 48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-changed-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Refreshing instance network info cache due to event network-changed-48e98eab-1914-45c5-8d77-e0ef29c397ad. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] Acquiring lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updated VIF entry in instance network info cache for port 9a6589da-cb11-4832-94f1-8645c12e1920. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ad9abec-1d61-449f-9b0b-33476d821c6b req-80a87e7c-5c07-416e-8dcf-92350644fcce service nova] Releasing lock "refresh_cache-2272a10b-5440-4635-88d1-3d3cac6d3cf9" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updating instance_info_cache with network_info: [{"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Instance network_info: |[{"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] Acquired lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Refreshing network info cache for port 48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updated VIF entry in instance network info cache for port 48e98eab-1914-45c5-8d77-e0ef29c397ad. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updating instance_info_cache with network_info: [{"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7363ad01-b7aa-4a5a-9fd9-8db38d845c47 req-a9f336c7-cf7d-44c2-89a2-78fa3f2e424e service nova] Releasing lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:53 user nova-compute[86931]: INFO nova.compute.manager [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Terminating instance
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-6a8f222d-914d-45f4-adfa-1e32e2992faf req-bc22b99a-2aa8-4f0e-ae70-84e39f42a77d service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-9a6589da-cb11-4832-94f1-8645c12e1920 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-7fec7fee-a5d9-45d4-898e-b7597c853a6b req-9e20270d-4c8d-44dd-a003-87d17458bc29 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0182fd2-d0cb-4891-aa93-20dfc62a9ca8 req-9ded2801-09e2-48c7-9ff0-fbc0762a8ee4 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:28:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Creating image(s)
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Ensure instance console log exists: /opt/stack/data/nova/instances/1e19b001-5671-4298-a979-9fe267b9efcd/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Start _get_guest_xml network_info=[{"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '4bf268aa-e8ff-442e-941b-032c1beea94f', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCaRBycw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e19b001-5671-4298-a979-9fe267b9efcd', 'attached_at': '', 'detached_at': '', 'volume_id': '7174d66e-4819-479a-977e-ab2fb2dc7efd', 'serial': '7174d66e-4819-479a-977e-ab2fb2dc7efd'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:28:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:28:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCaRBycw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:28:54 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:28:54 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:28:54 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42bc3bd-d932-4db0-b031-5c40cd3696a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:28:54 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b1707-0027-4eb5-bbeb-b760734d072d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd] added
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ccc225-3a13-4d40-ab1b-31a0ade2c62b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a51650-84c6-40e5-98cf-95cd4ad2084d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCaRBycw {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCaRBycw" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f45161-984c-4eb8-b0f1-82ee74566dc2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCaRBycw'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e046d0-1e14-41fc-aaa7-872c7c3dc3c7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Instance destroyed successfully.
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lazy-loading 'resources' on Instance uuid 2272a10b-5440-4635-88d1-3d3cac6d3cf9 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fed3093-5a34-4ecb-a407-556e72e13840]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a6589da-cb, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d3c8f-5da1-4a2c-af0a-38fe231d7904]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260]
Nov 16 19:28:54 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260] successful.
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e14275dc-7be3-4e99-aa08-7a41d90d39a7) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811e327-fda3-4d2b-8511-e1e297fe15e1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a278d3-63ad-42a9-9f94-8da026fc6772]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:54 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:54 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:fc:a3,bridge_name='br-int',has_traffic_filtering=True,id=9a6589da-cb11-4832-94f1-8645c12e1920,network=Network(11898064-5d8e-4ec0-a160-4cf795effa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6589da-cb')
Nov 16 19:28:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5d259-1979-4cc1-bf93-057e43bd8774]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCaRBycw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab86aa53-dd, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a6c83f8-e558-4db3-b628-50cb82d68ad5) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab86aa53-dd')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465b6ee0-ad, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=989c4de0-48b1-4588-b2ee-d2cedefed2fd) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:a2:45,bridge_name='br-int',has_traffic_filtering=True,id=465b6ee0-ad82-425f-bbab-f2d6f5644afe,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap465b6ee0-ad')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdccdd57b-93, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fd2a4f7-4c61-4976-937c-b780b0c2c20a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:2e:18,bridge_name='br-int',has_traffic_filtering=True,id=dccdd57b-9360-445e-b63a-8b8f656f4200,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdccdd57b-93')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap324bbe65-fc, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b9f48aa-f4bf-4939-82ef-98ecb8d5ac3a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2c:15,bridge_name='br-int',has_traffic_filtering=True,id=324bbe65-fcf9-4edd-aa32-9d0a02dd77ea,network=Network(da04f3d8-3327-47dc-961a-0d83db62f877),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324bbe65-fc')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap921c358a-17, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a4385dd-2eb2-4b81-b90a-8fa686ac679d) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-9a6589da-cb11-4832-94f1-8645c12e1920 for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-94499965-10f9-4269-96d1-f92df474fc8c for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-dde82799-c5e3-460f-854d-5a3702a9a983 req-8817524a-a038-4927-981f-d3f0aeff24fe service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-94499965-10f9-4269-96d1-f92df474fc8c for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:1c:54,bridge_name='br-int',has_traffic_filtering=True,id=921c358a-170e-4284-8e63-b2813df6b741,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap921c358a-17')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T19:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074577568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074577568',id=19,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIWU2mBZt3OwyS6N50OKqYKzf55nQwoNzaJHjATR5UtA1BsDuIO546zt+LDAa0N/3WFGqnhoi7usp+YiT03mRS/ilSAs4WAwvjjb9Jlz2yaeHiMqKoTjYCIGlJnmracg==',key_name='tempest-keypair-1260597705',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2afbf3678823422f977441f3e0439376',ramdisk_id='',reservation_id='r-8sxwz2mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1988088176',owner_user_name='tempest-TaggedBootDevicesTest-1988088176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce22181da8c0413783af4a8e80af3366',uuid=2272a10b-5440-4635-88d1-3d3cac6d3cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converting VIF {"id": "94499965-10f9-4269-96d1-f92df474fc8c", "address": "fa:16:3e:c7:89:7d", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94499965-10", "ovs_interfaceid": "94499965-10f9-4269-96d1-f92df474fc8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94499965-10, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7f3e190-e255-441a-9b58-34079164d959) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:55 user nova-compute[86931]: INFO os_vif [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:89:7d,bridge_name='br-int',has_traffic_filtering=True,id=94499965-10f9-4269-96d1-f92df474fc8c,network=Network(56a32ab7-13ed-4cbc-98ed-8cbe8e50652b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94499965-10')
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqVmPZWh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:28:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-a03f8ab7-ad5d-4044-ad5b-dea6e92c3378 req-c649b62a-65d0-4c5f-9fcb-c53aee17afd5 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-465b6ee0-ad82-425f-bbab-f2d6f5644afe for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-dccdd57b-9360-445e-b63a-8b8f656f4200 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-dccdd57b-9360-445e-b63a-8b8f656f4200 for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea for instance with vm_state active and task_state deleting.
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-unplugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-unplugged-921c358a-170e-4284-8e63-b2813df6b741 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Acquiring lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] No waiting events found dispatching network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:55 user nova-compute[86931]: WARNING nova.compute.manager [req-5da9789e-0071-4b16-9b31-88ba0edfd8ca req-669af7c1-2cb2-472c-9b5f-f1b825c87543 service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received unexpected event network-vif-plugged-921c358a-170e-4284-8e63-b2813df6b741 for instance with vm_state active and task_state deleting.
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26134616132313161', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134616132313161', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.504s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1646981388',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbi8RM8uJB9eC4o9U+Xeke40GtjCDSgdxIclaLxZt/WaHxBkoKHfThxUSEPQ/p3EinFvbylzj5bpGULkGw2cDrDT6fXCmg3JW3CkKdPbK5JPRxtnUVN6s2urJFuzaTn7g==',key_name='tempest-keypair-2030840794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-g28l2ke0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=1e19b001-5671-4298-a979-9fe267b9efcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e19b001-5671-4298-a979-9fe267b9efcd {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2bbda-bc5b-4673-896b-88e3acff1881]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: iSNS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: STATIC:
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: FIRMWARE:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:28:56 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:28:56 user nova-compute[86931]:   <uuid>1e19b001-5671-4298-a979-9fe267b9efcd</uuid>
Nov 16 19:28:56 user nova-compute[86931]:   <name>instance-00000015</name>
Nov 16 19:28:56 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:28:56 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:28:56 user nova-compute[86931]:   <metadata>
Nov 16 19:28:56 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:28:56 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:28:56 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1646981388</nova:name>
Nov 16 19:28:56 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:28:54</nova:creationTime>
Nov 16 19:28:56 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:28:56 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:28:56 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:28:56 user nova-compute[86931]:       <nova:owner>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:28:56 user nova-compute[86931]:       </nova:owner>
Nov 16 19:28:56 user nova-compute[86931]:       <nova:ports>
Nov 16 19:28:56 user nova-compute[86931]:         <nova:port uuid="48e98eab-1914-45c5-8d77-e0ef29c397ad">
Nov 16 19:28:56 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:28:56 user nova-compute[86931]:         </nova:port>
Nov 16 19:28:56 user nova-compute[86931]:       </nova:ports>
Nov 16 19:28:56 user nova-compute[86931]:     </nova:instance>
Nov 16 19:28:56 user nova-compute[86931]:   </metadata>
Nov 16 19:28:56 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:28:56 user nova-compute[86931]:     <system>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="serial">1e19b001-5671-4298-a979-9fe267b9efcd</entry>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="uuid">1e19b001-5671-4298-a979-9fe267b9efcd</entry>
Nov 16 19:28:56 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:28:56 user nova-compute[86931]:     </system>
Nov 16 19:28:56 user nova-compute[86931]:   </sysinfo>
Nov 16 19:28:56 user nova-compute[86931]:   <os>
Nov 16 19:28:56 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:28:56 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:28:56 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:28:56 user nova-compute[86931]:   </os>
Nov 16 19:28:56 user nova-compute[86931]:   <features>
Nov 16 19:28:56 user nova-compute[86931]:     <acpi/>
Nov 16 19:28:56 user nova-compute[86931]:     <apic/>
Nov 16 19:28:56 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:28:56 user nova-compute[86931]:   </features>
Nov 16 19:28:56 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:28:56 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:28:56 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:28:56 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:28:56 user nova-compute[86931]:   </clock>
Nov 16 19:28:56 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:28:56 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:28:56 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:28:56 user nova-compute[86931]:   </cpu>
Nov 16 19:28:56 user nova-compute[86931]:   <devices>
Nov 16 19:28:56 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:28:56 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:28:56 user nova-compute[86931]:       <source dev="/dev/sdd"/>
Nov 16 19:28:56 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:28:56 user nova-compute[86931]:       <serial>7174d66e-4819-479a-977e-ab2fb2dc7efd</serial>
Nov 16 19:28:56 user nova-compute[86931]:     </disk>
Nov 16 19:28:56 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:28:56 user nova-compute[86931]:       <mac address="fa:16:3e:d5:b6:8c"/>
Nov 16 19:28:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:28:56 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:28:56 user nova-compute[86931]:       <target dev="tap48e98eab-19"/>
Nov 16 19:28:56 user nova-compute[86931]:     </interface>
Nov 16 19:28:56 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:28:56 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/1e19b001-5671-4298-a979-9fe267b9efcd/console.log" append="off"/>
Nov 16 19:28:56 user nova-compute[86931]:     </serial>
Nov 16 19:28:56 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:28:56 user nova-compute[86931]:     <video>
Nov 16 19:28:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:28:56 user nova-compute[86931]:     </video>
Nov 16 19:28:56 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:28:56 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:28:56 user nova-compute[86931]:     </rng>
Nov 16 19:28:56 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:28:56 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:28:56 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:28:56 user nova-compute[86931]:     </memballoon>
Nov 16 19:28:56 user nova-compute[86931]:   </devices>
Nov 16 19:28:56 user nova-compute[86931]: </domain>
Nov 16 19:28:56 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1646981388',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbi8RM8uJB9eC4o9U+Xeke40GtjCDSgdxIclaLxZt/WaHxBkoKHfThxUSEPQ/p3EinFvbylzj5bpGULkGw2cDrDT6fXCmg3JW3CkKdPbK5JPRxtnUVN6s2urJFuzaTn7g==',key_name='tempest-keypair-2030840794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-g28l2ke0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=1e19b001-5671-4298-a979-9fe267b9efcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_vif [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c116388-9b7b-5e95-ae7f-35ab8191f8ce', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[21903549-528d-4864-b90f-a211c9ee9ce5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48e98eab-19, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48e98eab-19, col_values=(('qos', UUID('88fe10e7-135a-4b6e-b87e-a4493dce0078')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48e98eab-19, col_values=(('external_ids', {'iface-id': '48e98eab-1914-45c5-8d77-e0ef29c397ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b6:8c', 'vm-uuid': '1e19b001-5671-4298-a979-9fe267b9efcd'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5392a85-8109-475f-a718-e614c694f151]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c521f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: INFO os_vif [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19')
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b4e2ef-8125-4dc7-9d5b-71c06638d062]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a6b90-454f-431c-8288-bfe7ad228abe]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:d5:b6:8c, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f436c23-54ed-4be5-b58e-7607861152c6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[00968cf2-43ad-49f8-ac6a-de3b3db16226]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a91c32-eef8-4222-a15b-18c137690297]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ddc741-8d67-4090-8c28-1ca07a36dd9f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260]
Nov 16 19:28:56 user nova-compute[86931]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a, portal: 172.16.0.220,3260] successful.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27f432d4-68c6-4f34-9a77-e08f0074630a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec639b2b-1efe-4e09-bade-f967f47fdc04]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== disconnect_volume: return (842ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrePhsga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:28:56 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177f7e9-3cb6-472d-a313-b1c16138919f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: iSNS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: STATIC:
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: FIRMWARE:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:28:56 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[af23d88b-508f-4895-a186-786194df0f5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e625aa2d-96f8-40e1-8857-6c46ae34ff57]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c231480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e'): ({'sdg'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Removing single pathed devices sdg {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe6a332-8929-4a53-8a91-7e9e1d543a53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3fd3b-a436-4321-8682-77e50bc7efc0]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Flushing IO for device /dev/sdg {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972ab06-31e6-4a84-9413-5ed223e580dd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8407925-454d-4f7c-a992-854f21b2dfc5]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725b9ee-a204-420e-90bb-4946663bcdcf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8db274-8e7f-4e29-9c96-deb2da6a4aac]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260]
Nov 16 19:28:56 user nova-compute[86931]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e, portal: 172.16.0.220,3260] successful.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52971909-37cc-4721-a2dd-b0ffbf428e9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5faa3c6-36d6-4d6f-86d9-439f7bcbf42f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== disconnect_volume: return (322ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NpKIymuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:28:56 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb8ecda-597c-4bf2-be94-d9a8daa78406]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: iSNS:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]: STATIC:
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:28:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:28:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:28:56 user nova-compute[86931]: FIRMWARE:
Nov 16 19:28:56 user nova-compute[86931]: No targets found.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:28:56 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:28:56 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[be49b99a-fc98-4a48-813d-b12403e30a26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24857c9-1a91-45cc-9552-2a3974105392]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:28:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c231480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4ebd70-36ce-436c-91c6-ae1d54790060]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd38d14a-6757-4040-a9c6-aa930c73a6d7]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39f90bc-7800-43bb-b49c-75986f4b594d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975b860-f7ab-4eb7-bf66-f682ce5958a1]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6b82e-5019-499f-be5c-c5fb6041e750]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cfd1d-99d9-4dc5-9a4e-0e9c93bd603e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260]
Nov 16 19:28:56 user nova-compute[86931]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84, portal: 172.16.0.220,3260] successful.
Nov 16 19:28:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6fde861-1347-47a6-97db-f9d8e0d6db84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98e0f7-8726-44a8-98ff-1f22f924353a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] <== disconnect_volume: return (298ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:28:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:28:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Deleting instance files /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9_del
Nov 16 19:28:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Deletion of /opt/stack/data/nova/instances/2272a10b-5440-4635-88d1-3d3cac6d3cf9_del complete
Nov 16 19:28:57 user nova-compute[86931]: INFO nova.compute.manager [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Took 3.99 seconds to destroy the instance on the hypervisor.
Nov 16 19:28:57 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] No waiting events found dispatching network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:57 user nova-compute[86931]: WARNING nova.compute.manager [req-0e7506bb-7719-4646-bee4-c90faccabb86 req-2b815edf-3fe2-4f80-9783-9e9ced91e9ec service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received unexpected event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad for instance with vm_state building and task_state spawning.
Nov 16 19:28:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:28:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Instance spawned successfully.
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:28:59 user nova-compute[86931]: INFO nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:28:59 user nova-compute[86931]: INFO nova.compute.manager [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Took 11.97 seconds to build instance.
Nov 16 19:28:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1eb39693-c83f-4f16-8547-827a39db42ad tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.162s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] No waiting events found dispatching network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:28:59 user nova-compute[86931]: WARNING nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received unexpected event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad for instance with vm_state active and task_state None.
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-deleted-94499965-10f9-4269-96d1-f92df474fc8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:59 user nova-compute[86931]: INFO nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Neutron deleted interface 94499965-10f9-4269-96d1-f92df474fc8c; detaching it from the instance and deleting it from the info cache
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [{"id": "9a6589da-cb11-4832-94f1-8645c12e1920", "address": "fa:16:3e:d2:fc:a3", "network": {"id": "11898064-5d8e-4ec0-a160-4cf795effa97", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-966589333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6589da-cb", "ovs_interfaceid": "9a6589da-cb11-4832-94f1-8645c12e1920", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Detach interface failed, port_id=94499965-10f9-4269-96d1-f92df474fc8c, reason: Instance 2272a10b-5440-4635-88d1-3d3cac6d3cf9 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-deleted-9a6589da-cb11-4832-94f1-8645c12e1920 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:28:59 user nova-compute[86931]: INFO nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Neutron deleted interface 9a6589da-cb11-4832-94f1-8645c12e1920; detaching it from the instance and deleting it from the info cache
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [{"id": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "address": "fa:16:3e:ec:20:2c", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab86aa53-dd", "ovs_interfaceid": "ab86aa53-dd8f-4b1e-ac05-9cb9bdf2521b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "address": "fa:16:3e:b7:a2:45", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465b6ee0-ad", "ovs_interfaceid": "465b6ee0-ad82-425f-bbab-f2d6f5644afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dccdd57b-9360-445e-b63a-8b8f656f4200", "address": "fa:16:3e:6c:2e:18", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdccdd57b-93", "ovs_interfaceid": "dccdd57b-9360-445e-b63a-8b8f656f4200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "address": "fa:16:3e:3a:2c:15", "network": {"id": "da04f3d8-3327-47dc-961a-0d83db62f877", "bridge": "br-int", "label": "tempest-device-tagging-net1-335098418", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324bbe65-fc", "ovs_interfaceid": "324bbe65-fcf9-4edd-aa32-9d0a02dd77ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "921c358a-170e-4284-8e63-b2813df6b741", "address": "fa:16:3e:27:1c:54", "network": {"id": "56a32ab7-13ed-4cbc-98ed-8cbe8e50652b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1574699348", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2afbf3678823422f977441f3e0439376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap921c358a-17", "ovs_interfaceid": "921c358a-170e-4284-8e63-b2813df6b741", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:28:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-cb93251a-3b73-4922-8fcc-b60973118663 req-2388db13-53a0-434f-a35f-ac595bc18eff service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Detach interface failed, port_id=9a6589da-cb11-4832-94f1-8645c12e1920, reason: Instance 2272a10b-5440-4635-88d1-3d3cac6d3cf9 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:29:00 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:29:00 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Took 3.76 seconds to deallocate network for instance.
Nov 16 19:29:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-3f69f5ec-93b5-4e33-871c-ea3f17bcdddc req-6615bd06-14e2-47d6-b723-31d3c7816aec service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-deleted-921c358a-170e-4284-8e63-b2813df6b741 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-3f69f5ec-93b5-4e33-871c-ea3f17bcdddc req-6615bd06-14e2-47d6-b723-31d3c7816aec service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-deleted-dccdd57b-9360-445e-b63a-8b8f656f4200 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-3f69f5ec-93b5-4e33-871c-ea3f17bcdddc req-6615bd06-14e2-47d6-b723-31d3c7816aec service nova] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Received event network-vif-deleted-324bbe65-fcf9-4edd-aa32-9d0a02dd77ea {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:03 user nova-compute[86931]: INFO nova.compute.manager [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] [instance: 2272a10b-5440-4635-88d1-3d3cac6d3cf9] Took 2.51 seconds to detach 3 volumes for instance.
Nov 16 19:29:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:03 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:29:03 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:29:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:03 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Deleted allocations for instance 2272a10b-5440-4635-88d1-3d3cac6d3cf9
Nov 16 19:29:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fc23ef4d-7a59-4d29-8508-8f6fcfb44aab tempest-TaggedBootDevicesTest-1988088176 tempest-TaggedBootDevicesTest-1988088176-project-member] Lock "2272a10b-5440-4635-88d1-3d3cac6d3cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.793s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:37 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:38 user nova-compute[86931]: INFO nova.compute.manager [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Terminating instance
Nov 16 19:29:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-unplugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] No waiting events found dispatching network-vif-unplugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:29:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-6016ecd9-3078-42f8-a839-d1226a3512a5 req-046dde6e-df58-4e36-9032-3ee5b3cdabd7 service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-unplugged-4d3a670d-4765-4455-bee7-960ce6a1015c for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:29:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Instance destroyed successfully.
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lazy-loading 'resources' on Instance uuid a3eb0784-f6eb-406b-9b04-acbf26eff8be {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-350445119',display_name='tempest-ServersNegativeTestJSON-server-350445119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-350445119',id=20,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-c2gjvsx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:56Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=a3eb0784-f6eb-406b-9b04-acbf26eff8be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "4d3a670d-4765-4455-bee7-960ce6a1015c", "address": "fa:16:3e:4c:8d:ab", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d3a670d-47", "ovs_interfaceid": "4d3a670d-4765-4455-bee7-960ce6a1015c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG os_vif [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d3a670d-47, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cec8e846-8c22-4a85-b019-62168a77ad71) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:39 user nova-compute[86931]: INFO os_vif [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:8d:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d3a670d-4765-4455-bee7-960ce6a1015c,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d3a670d-47')
Nov 16 19:29:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Deleting instance files /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be_del
Nov 16 19:29:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Deletion of /opt/stack/data/nova/instances/a3eb0784-f6eb-406b-9b04-acbf26eff8be_del complete
Nov 16 19:29:39 user nova-compute[86931]: INFO nova.compute.manager [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 19:29:39 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:29:39 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Took 0.59 seconds to deallocate network for instance.
Nov 16 19:29:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-643187b4-5e09-4544-aaa2-5f297fe454ca req-1a8cd889-5c99-48a3-a22d-6e7e1be84b9f service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-deleted-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:40 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Deleted allocations for instance a3eb0784-f6eb-406b-9b04-acbf26eff8be
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c2eb6e6b-e710-411f-bc29-d28d38e4ea99 tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] Acquiring lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] Lock "a3eb0784-f6eb-406b-9b04-acbf26eff8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] No waiting events found dispatching network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:29:40 user nova-compute[86931]: WARNING nova.compute.manager [req-84d31e64-11cc-491b-97b0-2205bbabcaf3 req-e8b7d1ee-5488-4654-ad8e-ebb4d0478a7a service nova] [instance: a3eb0784-f6eb-406b-9b04-acbf26eff8be] Received unexpected event network-vif-plugged-4d3a670d-4765-4455-bee7-960ce6a1015c for instance with vm_state deleted and task_state None.
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:29:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquired lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'info_cache' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Releasing lock "refresh_cache-08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance destroyed successfully.
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'resources' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG os_vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b4eea3-5c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac2a0e6c-8842-4fe9-978d-f6ac72864b14) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:44 user nova-compute[86931]: INFO os_vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start _get_guest_xml network_info=[{"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'numa_topology' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:44 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:29:44 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'pci_devices' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:29:44 user nova-compute[86931]:   <uuid>08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</uuid>
Nov 16 19:29:44 user nova-compute[86931]:   <name>instance-00000002</name>
Nov 16 19:29:44 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:29:44 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:29:44 user nova-compute[86931]:   <metadata>
Nov 16 19:29:44 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:29:44 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeTestJSON-server-617281987</nova:name>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:29:44</nova:creationTime>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:29:44 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:29:44 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:owner>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:user uuid="608adfbbb5d74367a409c645ee871f6c">tempest-AttachVolumeTestJSON-1412638370-project-member</nova:user>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:project uuid="3cfa544a56b847afbf03a50f1e7603f2">tempest-AttachVolumeTestJSON-1412638370</nova:project>
Nov 16 19:29:44 user nova-compute[86931]:       </nova:owner>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:29:44 user nova-compute[86931]:       <nova:ports>
Nov 16 19:29:44 user nova-compute[86931]:         <nova:port uuid="81b4eea3-5c4e-4a28-8c21-51adc18be286">
Nov 16 19:29:44 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:29:44 user nova-compute[86931]:         </nova:port>
Nov 16 19:29:44 user nova-compute[86931]:       </nova:ports>
Nov 16 19:29:44 user nova-compute[86931]:     </nova:instance>
Nov 16 19:29:44 user nova-compute[86931]:   </metadata>
Nov 16 19:29:44 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:29:44 user nova-compute[86931]:     <system>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="serial">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="uuid">08ef1b8a-6ff3-4322-b9ea-7ca7e838a829</entry>
Nov 16 19:29:44 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:29:44 user nova-compute[86931]:     </system>
Nov 16 19:29:44 user nova-compute[86931]:   </sysinfo>
Nov 16 19:29:44 user nova-compute[86931]:   <os>
Nov 16 19:29:44 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:29:44 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:29:44 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:29:44 user nova-compute[86931]:   </os>
Nov 16 19:29:44 user nova-compute[86931]:   <features>
Nov 16 19:29:44 user nova-compute[86931]:     <acpi/>
Nov 16 19:29:44 user nova-compute[86931]:     <apic/>
Nov 16 19:29:44 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:29:44 user nova-compute[86931]:   </features>
Nov 16 19:29:44 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:29:44 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:29:44 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:29:44 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:29:44 user nova-compute[86931]:   </clock>
Nov 16 19:29:44 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:29:44 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:29:44 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:29:44 user nova-compute[86931]:   </cpu>
Nov 16 19:29:44 user nova-compute[86931]:   <devices>
Nov 16 19:29:44 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:29:44 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:29:44 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk"/>
Nov 16 19:29:44 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:29:44 user nova-compute[86931]:     </disk>
Nov 16 19:29:44 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:29:44 user nova-compute[86931]:       <mac address="fa:16:3e:00:91:45"/>
Nov 16 19:29:44 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:29:44 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:29:44 user nova-compute[86931]:       <target dev="tap81b4eea3-5c"/>
Nov 16 19:29:44 user nova-compute[86931]:     </interface>
Nov 16 19:29:44 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:29:44 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/console.log" append="off"/>
Nov 16 19:29:44 user nova-compute[86931]:     </serial>
Nov 16 19:29:44 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:29:44 user nova-compute[86931]:     <video>
Nov 16 19:29:44 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:29:44 user nova-compute[86931]:     </video>
Nov 16 19:29:44 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:29:44 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:29:44 user nova-compute[86931]:     </rng>
Nov 16 19:29:44 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:29:44 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:29:44 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:29:44 user nova-compute[86931]:     </memballoon>
Nov 16 19:29:44 user nova-compute[86931]:   </devices>
Nov 16 19:29:44 user nova-compute[86931]: </domain>
Nov 16 19:29:44 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.577s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:45 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:29:45 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=25.330387115478516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 1e19b001-5671-4298-a979-9fe267b9efcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Cannot resize image /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'migration_context' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.objects.base [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Object Instance<08ef1b8a-6ff3-4322-b9ea-7ca7e838a829> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG os_vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '313f2824-128d-59aa-a037-c3faadf5b381', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b4eea3-5c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81b4eea3-5c, col_values=(('qos', UUID('f2c17537-f395-47c5-ad78-29cf494934d0')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81b4eea3-5c, col_values=(('external_ids', {'iface-id': '81b4eea3-5c4e-4a28-8c21-51adc18be286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:91:45', 'vm-uuid': '08ef1b8a-6ff3-4322-b9ea-7ca7e838a829'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:29:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:45 user nova-compute[86931]: INFO os_vif [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:29:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:29:47 user nova-compute[86931]: WARNING nova.compute.manager [req-52107100-9c2a-4fa9-8515-5755ad5765da req-7699665a-34b0-4f29-9b75-e6ca2fc791e5 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state powering-on.
Nov 16 19:29:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:29:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'flavor' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:48 user nova-compute[86931]: INFO nova.compute.manager [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attaching volume 791c1da6-8867-4663-bf64-b651af99c02b to /dev/vdb
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.utils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78c446-ca45-4484-8768-ca8d140ce4ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3624da38-7829-411a-bd9a-f6a5ecf84472]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bfbcff-d6e6-441a-b2ff-215a37824803]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf2ed2f-74c8-438f-b2b2-09347d1c9c69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:29:48 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:29:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca88af-4c18-49b1-ad3a-ddc501fddb2a]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG os_brick.utils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:29:48 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating existing volume attachment record: 8b03851f-904b-4029-bd16-54de5ad4d40f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:29:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:29:49 user nova-compute[86931]: WARNING nova.compute.manager [req-c21d3572-0243-45a9-b041-9da03b781a66 req-3b1e5b6b-bad1-4240-ab2c-480730beb31a service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state stopped and task_state powering-on.
Nov 16 19:29:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:29:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance rebooted successfully.
Nov 16 19:29:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5e1016ad-1ccd-464d-aeea-dbb567ed428c tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:29:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:53 user nova-compute[86931]: DEBUG nova.objects.instance [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'flavor' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:54 user nova-compute[86931]: INFO nova.compute.manager [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Attaching volume 3bde119e-a77d-4827-ad77-02b4dbb12877 to /dev/vdb
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa0470-c3e7-4998-bd64-d5536b1aa9b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea42b2f0-674a-40e3-86bf-52df34bb706f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57cda62-10b7-48dd-894a-357e1950618f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91b83ee-b1ab-4382-b4c8-f90c52a3bf96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:29:54 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30d32b-30a5-42fb-ae5f-6fbaa1908c83]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating existing volume attachment record: 1f4a6a73-b033-421d-8e9e-63e9075030ff {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:29:54 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:29:54 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:29:54 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[438fc45c-f401-4581-b3e8-de9c38573020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:29:54 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37c1dc-5e3b-4411-86bd-9064679b032e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b] added
Nov 16 19:29:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5feffaf-cf25-4ea6-9134-c4c5fcc68b45]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a5093-5392-4119-b61f-f3e456b17c47]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZinUcDC {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZinUcDC" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dcc84a-aa6a-4e8d-aba4-b347b028e585]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KZinUcDC'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92fdd3-1793-4d71-95d4-ba7923b09d38]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5582cfe-5c50-4a4f-9c28-8ddf78cb7902]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:29:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:29:54 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:29:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:29:54 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:29:54 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:29:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a7196-bd4d-4c0f-859a-55485192214e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260]
Nov 16 19:29:54 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260] successful.
Nov 16 19:29:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b0b0d-78f0-4e79-8ee5-667770bdd514]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:29:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f23750f-ebde-4b06-892c-c4e203506e54]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:29:55 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:29:55 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:29:55 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b968847-6cb5-4f5a-bfb2-80c326db9fa0]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:29:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23235383664366265', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383664366265', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'flavor' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:29:56 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:29:56 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:29:56 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:29:56 user nova-compute[86931]:   <serial>791c1da6-8867-4663-bf64-b651af99c02b</serial>
Nov 16 19:29:56 user nova-compute[86931]: </disk>
Nov 16 19:29:56 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No VIF found with MAC fa:16:3e:96:33:4c, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:29:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b36c8bb1-dc89-4faa-b940-bd7bc351b448 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.350s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:57 user nova-compute[86931]: INFO nova.compute.manager [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Rescuing
Nov 16 19:29:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:29:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:29:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:29:58 user nova-compute[86931]: WARNING nova.compute.manager [req-d7aa0b22-2e80-416f-bb46-62711f494707 req-e9d77f61-f724-4b13-9dc9-883152c4841c service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state rescuing.
Nov 16 19:29:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance destroyed successfully.
Nov 16 19:29:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attempting a stable device rescue
Nov 16 19:29:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:29:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Creating image(s)
Nov 16 19:29:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "c866a8da8354f91287dafbf5b87037efb6afe932" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:29:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "c866a8da8354f91287dafbf5b87037efb6afe932" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.part --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG nova.virt.images [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] e7e091a4-5418-4a1e-ba72-ea733a27fb1d was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.part /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:00 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:00 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:00 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba51b7-6df0-402d-9c33-07f8b6b0ec48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:30:00 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c28ffe-090a-49ef-a72e-dc3745e12959]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added
Nov 16 19:30:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.076s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec96130a-5165-4b7a-9a0a-c551e3e6b7e4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff527c63-277e-4ec5-ada0-6c02bba36d72]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:00 user nova-compute[86931]: WARNING nova.compute.manager [req-7436f54b-db24-435f-b0f6-011369184dda req-46d9d1bc-6809-42cc-a47f-a2f2276a84ac service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state rescuing.
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485590a-e47c-4d22-be7e-90830599bf34]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzuqynsB'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce4d91-4b05-4ed2-b89e-9d9f71b706bc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.part /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.converted" returned: 0 in 0.407s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad72ce9-6c59-4299-bd64-3526a3f9df3a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47033510-718d-4bfd-aa63-997f110e3d14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:30:01 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:30:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada85f1-8b34-41d7-911c-86afd42190c7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a3a12-34dc-4214-81f3-c9ffd8765b2e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:01 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.535s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f877f-90f3-42c7-8263-093a7ed9461b]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "c866a8da8354f91287dafbf5b87037efb6afe932" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.867s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "c866a8da8354f91287dafbf5b87037efb6afe932" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "c866a8da8354f91287dafbf5b87037efb6afe932" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932 --force-share --output=json" returned: 0 in 0.231s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932,backing_fmt=raw /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932,backing_fmt=raw /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue" returned: 0 in 0.052s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "c866a8da8354f91287dafbf5b87037efb6afe932" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'migration_context' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Object Instance<3b54f114-2b97-4b0b-9149-06347861d653> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start _get_guest_xml network_info=[{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "vif_mac": "fa:16:3e:96:33:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e7e091a4-5418-4a1e-ba72-ea733a27fb1d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '8b03851f-904b-4029-bd16-54de5ad4d40f', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3b54f114-2b97-4b0b-9149-06347861d653', 'attached_at': '', 'detached_at': '', 'volume_id': '791c1da6-8867-4663-bf64-b651af99c02b', 'serial': '791c1da6-8867-4663-bf64-b651af99c02b'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'resources' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Object Instance<3b54f114-2b97-4b0b-9149-06347861d653> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'numa_topology' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Object Instance<3b54f114-2b97-4b0b-9149-06347861d653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:30:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.objects.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Object Instance<3b54f114-2b97-4b0b-9149-06347861d653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.573s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.555s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:02 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.objects.instance [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'flavor' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[99469363-ea43-4167-9775-43b0f1e78e48]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KZinUcDC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 19:30:02 user nova-compute[86931]: node.name = iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:30:02 user nova-compute[86931]: node.tpgt = -1
Nov 16 19:30:02 user nova-compute[86931]: node.startup = automatic
Nov 16 19:30:02 user nova-compute[86931]: node.leading_login = No
Nov 16 19:30:02 user nova-compute[86931]: iface.iscsi_ifacename = default
Nov 16 19:30:02 user nova-compute[86931]: iface.net_ifacename = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.ipaddress = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.prefix_len = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.hwaddress = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.transport_name = tcp
Nov 16 19:30:02 user nova-compute[86931]: iface.initiatorname = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.vlan_id = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.vlan_priority = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.vlan_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.iface_num = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.mtu = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.port = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.bootproto = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.subnet_mask = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.gateway = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_alt_client_id = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_dns = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_learn_iqn = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_vendor_id_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_vendor_id = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.dhcp_slp_da = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.fragmentation = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.gratuitous_arp = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.incoming_forwarding = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.tos_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.tos = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.ttl = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.delayed_ack = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.tcp_nagle = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.tcp_wsf_state = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.tcp_wsf = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.tcp_timer_scale = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.tcp_timestamp = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.redirect = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.def_task_mgmt_timeout = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.header_digest = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.data_digest = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.immediate_data = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.initial_r2t = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.data_seq_inorder = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.data_pdu_inorder = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.erl = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.max_receive_data_len = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.first_burst_len = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.max_outstanding_r2t = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.max_burst_len = 0
Nov 16 19:30:02 user nova-compute[86931]: iface.chap_auth = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.bidi_chap = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.strict_login_compliance = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.discovery_auth = <empty>
Nov 16 19:30:02 user nova-compute[86931]: iface.discovery_logout = <empty>
Nov 16 19:30:02 user nova-compute[86931]: node.discovery_address = <empty>
Nov 16 19:30:02 user nova-compute[86931]: node.discovery_port = 0
Nov 16 19:30:02 user nova-compute[86931]: node.discovery_type = static
Nov 16 19:30:02 user nova-compute[86931]: node.session.initial_cmdsn = 0
Nov 16 19:30:02 user nova-compute[86931]: node.session.initial_login_retry_max = 8
Nov 16 19:30:02 user nova-compute[86931]: node.session.xmit_thread_priority = -20
Nov 16 19:30:02 user nova-compute[86931]: node.session.cmds_max = 128
Nov 16 19:30:02 user nova-compute[86931]: node.session.queue_depth = 32
Nov 16 19:30:02 user nova-compute[86931]: node.session.nr_sessions = 1
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.authmethod = CHAP
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.username = KZinUcDC
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.password = ***
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.username_in = <empty>
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.password_in = <empty>
Nov 16 19:30:02 user nova-compute[86931]: node.session.auth.chap_algs = MD5
Nov 16 19:30:02 user nova-compute[86931]: node.session.timeo.replacement_timeout = 120
Nov 16 19:30:02 user nova-compute[86931]: node.session.err_timeo.abort_timeout = 15
Nov 16 19:30:02 user nova-compute[86931]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 19:30:02 user nova-compute[86931]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 19:30:02 user nova-compute[86931]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.FastAbort = Yes
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.InitialR2T = No
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.ImmediateData = Yes
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.MaxConnections = 1
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 19:30:02 user nova-compute[86931]: node.session.iscsi.ERL = 0
Nov 16 19:30:02 user nova-compute[86931]: node.session.scan = manual
Nov 16 19:30:02 user nova-compute[86931]: node.session.reopen_max = 0
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].address = 172.16.0.220
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].port = 3260
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].startup = manual
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].tcp.window_size = 524288
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].tcp.type_of_service = 0
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].timeo.logout_timeout = 15
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].timeo.login_timeout = 15
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].timeo.auth_timeout = 45
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.DataDigest = None
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.IFMarker = No
Nov 16 19:30:02 user nova-compute[86931]: node.conn[0].iscsi.OFMarker = No
Nov 16 19:30:02 user nova-compute[86931]: # END RECORD
Nov 16 19:30:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:30:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:02 user nova-compute[86931]:   <source dev="/dev/sde"/>
Nov 16 19:30:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:   <serial>3bde119e-a77d-4827-ad77-02b4dbb12877</serial>
Nov 16 19:30:02 user nova-compute[86931]: </disk>
Nov 16 19:30:02 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e5cb4a-6ea5-4c8d-a4aa-7e706192242c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe9c32-67dd-4283-ab49-deec2c9a14a6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZinUcDC {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZinUcDC" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff69058-4648-4081-8592-d64527d38be1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KZinUcDC'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac37bd4-5887-46d1-bf84-8bcf8a96b07b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161af4e-e06c-48cc-bfe2-e6015c3fd4f6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:02 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ae40cd-3fd1-4660-924f-0dc4d5e0d46b]: (4, ('0 0 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] <== connect_volume: return (751ms) {'type': 'block', 'scsi_wwn': '23235383664366265', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383664366265', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1431386963',display_name='tempest-ServerStableDeviceRescueTest-server-1431386963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1431386963',id=17,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSzYEh+wZ7nuNSMVhh98XEp5OjAKuoAbCz50lqaWXPtCcQ31Da5YhvKJ+JECZY9P2FQMJJ50l9qalXeXUoVIuB52v8dY17SPFqLUZVA2CdWuK5qoV12xVPg7SGgHoVyA==',key_name='tempest-keypair-1478691447',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1528a5e3fa244d98aa3ac2231fd3173',ramdisk_id='',reservation_id='r-mu4t02uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1093973425',owner_user_name='tempest-ServerStableDeviceRescueTest-1093973425-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e43f609e3244c25bc951e870d50e639',uuid=3b54f114-2b97-4b0b-9149-06347861d653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "vif_mac": "fa:16:3e:96:33:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converting VIF {"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "vif_mac": "fa:16:3e:96:33:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.objects.base [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Object Instance<3b54f114-2b97-4b0b-9149-06347861d653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:30:02 user nova-compute[86931]:   <uuid>3b54f114-2b97-4b0b-9149-06347861d653</uuid>
Nov 16 19:30:02 user nova-compute[86931]:   <name>instance-00000011</name>
Nov 16 19:30:02 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:30:02 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:30:02 user nova-compute[86931]:   <metadata>
Nov 16 19:30:02 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:30:02 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1431386963</nova:name>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:30:01</nova:creationTime>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:30:02 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:30:02 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:owner>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:user uuid="4e43f609e3244c25bc951e870d50e639">tempest-ServerStableDeviceRescueTest-1093973425-project-member</nova:user>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:project uuid="b1528a5e3fa244d98aa3ac2231fd3173">tempest-ServerStableDeviceRescueTest-1093973425</nova:project>
Nov 16 19:30:02 user nova-compute[86931]:       </nova:owner>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:30:02 user nova-compute[86931]:       <nova:ports>
Nov 16 19:30:02 user nova-compute[86931]:         <nova:port uuid="8997ab3d-23ec-4b9b-8743-8269f35eb4a0">
Nov 16 19:30:02 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 19:30:02 user nova-compute[86931]:         </nova:port>
Nov 16 19:30:02 user nova-compute[86931]:       </nova:ports>
Nov 16 19:30:02 user nova-compute[86931]:     </nova:instance>
Nov 16 19:30:02 user nova-compute[86931]:   </metadata>
Nov 16 19:30:02 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:30:02 user nova-compute[86931]:     <system>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="serial">3b54f114-2b97-4b0b-9149-06347861d653</entry>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="uuid">3b54f114-2b97-4b0b-9149-06347861d653</entry>
Nov 16 19:30:02 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:30:02 user nova-compute[86931]:     </system>
Nov 16 19:30:02 user nova-compute[86931]:   </sysinfo>
Nov 16 19:30:02 user nova-compute[86931]:   <os>
Nov 16 19:30:02 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:30:02 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:30:02 user nova-compute[86931]:   </os>
Nov 16 19:30:02 user nova-compute[86931]:   <features>
Nov 16 19:30:02 user nova-compute[86931]:     <acpi/>
Nov 16 19:30:02 user nova-compute[86931]:     <apic/>
Nov 16 19:30:02 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:30:02 user nova-compute[86931]:   </features>
Nov 16 19:30:02 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:30:02 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:30:02 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:30:02 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:30:02 user nova-compute[86931]:   </clock>
Nov 16 19:30:02 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:30:02 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:30:02 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:30:02 user nova-compute[86931]:   </cpu>
Nov 16 19:30:02 user nova-compute[86931]:   <devices>
Nov 16 19:30:02 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:30:02 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:30:02 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk"/>
Nov 16 19:30:02 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:     </disk>
Nov 16 19:30:02 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:30:02 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:02 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:30:02 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:       <serial>791c1da6-8867-4663-bf64-b651af99c02b</serial>
Nov 16 19:30:02 user nova-compute[86931]:     </disk>
Nov 16 19:30:02 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:30:02 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:30:02 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue"/>
Nov 16 19:30:02 user nova-compute[86931]:       <target dev="vdc" bus="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:       <boot order="1"/>
Nov 16 19:30:02 user nova-compute[86931]:     </disk>
Nov 16 19:30:02 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:30:02 user nova-compute[86931]:       <mac address="fa:16:3e:96:33:4c"/>
Nov 16 19:30:02 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:30:02 user nova-compute[86931]:       <target dev="tap8997ab3d-23"/>
Nov 16 19:30:02 user nova-compute[86931]:     </interface>
Nov 16 19:30:02 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:30:02 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/console.log" append="off"/>
Nov 16 19:30:02 user nova-compute[86931]:     </serial>
Nov 16 19:30:02 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:30:02 user nova-compute[86931]:     <video>
Nov 16 19:30:02 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:02 user nova-compute[86931]:     </video>
Nov 16 19:30:02 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:30:02 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:30:02 user nova-compute[86931]:     </rng>
Nov 16 19:30:02 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:30:02 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:30:02 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:30:02 user nova-compute[86931]:     </memballoon>
Nov 16 19:30:02 user nova-compute[86931]:   </devices>
Nov 16 19:30:02 user nova-compute[86931]: </domain>
Nov 16 19:30:02 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:30:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance destroyed successfully.
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] No VIF found with MAC fa:16:3e:96:33:4c, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No VIF found with MAC fa:16:3e:74:67:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:30:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-25fab7af-b97a-4d94-8d27-84467a5040c9 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.813s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:04 user nova-compute[86931]: WARNING nova.compute.manager [req-631471ba-4b40-4b4e-a02c-cea38e7797e8 req-169a8a0a-9825-485a-aebb-8f0aeef5ea35 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state rescuing.
Nov 16 19:30:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Stashing vm_state: active {{(pid=86931) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:30:06 user nova-compute[86931]: INFO nova.compute.claims [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Claim successful on node user
Nov 16 19:30:06 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating resource usage from migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:06 user nova-compute[86931]: WARNING nova.compute.manager [req-b470ea13-f930-4371-81ec-3c169006786b req-606f254f-151d-4701-9060-98540718c087 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state rescuing.
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.417s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:06 user nova-compute[86931]: INFO nova.compute.manager [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Migrating
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "compute-rpcapi-router" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:06 user nova-compute[86931]: INFO nova.compute.rpcapi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "compute-rpcapi-router" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ff6f7896-e084-4f4c-bed0-d6b7a8af3140 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Starting migrate_disk_and_power_off {{(pid=86931) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance destroyed successfully.
Nov 16 19:30:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec0dd494-b4, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9f6ec01-4dcb-4060-b9d8-a6ca1131ab1a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:07 user nova-compute[86931]: INFO os_vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:30:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:07 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11904f7-d933-4a7d-bb0b-ef7afc38e499]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:30:07 user nova-compute[86931]: No targets found.
Nov 16 19:30:07 user nova-compute[86931]: iSNS:
Nov 16 19:30:07 user nova-compute[86931]: No targets found.
Nov 16 19:30:07 user nova-compute[86931]: STATIC:
Nov 16 19:30:07 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:30:07 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:07 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:07 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:30:07 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:07 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:07 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:30:07 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:07 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:07 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:30:07 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:07 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:07 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:30:07 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:07 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:07 user nova-compute[86931]: FIRMWARE:
Nov 16 19:30:07 user nova-compute[86931]: No targets found.
Nov 16 19:30:07 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:30:07 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:30:07 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[febaa5a9-ae81-4959-b7bb-cc9401c811cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08d437-d370-4432-8faf-078ac556a923]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:08 user nova-compute[86931]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c622e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4714f05-f274-47bc-842e-38be4b0dc5aa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea83eb3-e485-426c-a105-2b947c21fe6f]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2729f1-9ada-48dc-a092-004d66af90a7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cfd1ff-1a36-4220-93e7-fe474e724084]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0797d38-c33d-4c2b-bcad-2ad9ad8f8d68]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc91bcb-60f5-4a3f-bcca-dbdb4c55892a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:30:08 user nova-compute[86931]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:30:08 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5647d611-7980-48d7-beed-ea64d037ae36]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== disconnect_volume: return (348ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:08 user nova-compute[86931]: WARNING nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state active and task_state resize_migrating.
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:08 user nova-compute[86931]: WARNING nova.compute.manager [req-bdac88d8-34a3-487e-98d2-20bb8a2f1945 req-c30b6ddd-60ac-4188-944e-8b0ff652539b service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state active and task_state resize_migrating.
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:30:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_resize/disk /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "cp -r /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_resize/disk /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk" returned: 0 in 0.376s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_resize/disk.info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk.info {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "cp -r /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_resize/disk.info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk.info" returned: 0 in 0.030s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 binding to destination host user is already ACTIVE {{(pid=86931) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba907484-2c64-444e-8a82-c4c3b5b715e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[751bbdff-81ac-4ea1-8a33-b6d6fe8cf334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33b4310-27c8-4a71-aeb2-2336ab4f55e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f79a132-079c-4d4f-bd29-17459a83b9f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:30:11 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:30:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a40cfb-0b2a-4e27-b683-d6bb6b3ce767]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Starting finish_migration {{(pid=86931) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:30:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Creating image(s)
Nov 16 19:30:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk. size=21474836480 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:30:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk 21474836480 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk 21474836480" returned: 0 in 0.381s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Ensure instance console log exists: /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start _get_guest_xml network_info=[{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '395c325f-8f65-44c6-9345-875a24f29aee', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4dfb53cd-4239-4cea-80d5-ecd6ac8ed200', 'attached_at': '2023-11-16T19:30:17.000000', 'detached_at': '', 'volume_id': '3bde119e-a77d-4827-ad77-02b4dbb12877', 'serial': '3bde119e-a77d-4827-ad77-02b4dbb12877'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:30:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:17 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7eaec-00c6-46bb-8355-8fa7c456517f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:30:17 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff0afe-7a83-49d6-b45a-6b47e125e0bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[906c0862-6e3c-4c2e-9c2c-2c1f96dafd9e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ab57e-3988-4bbb-90be-a97b9ff49454]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88933f3-e033-43a1-b521-1ebd895c777f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzuqynsB'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced7591-f824-409e-b5f1-c29aa8bbc7e5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ae50ee-be90-4391-aa41-b30a8bbb968f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39adca-fabb-4593-bc88-d5871a039667]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:30:17 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd16066-7e85-42f9-8773-6c3112cb4667]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60664b-aa2a-4a57-9131-458b1f591488]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:17 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39215cd-28bf-4ef4-b381-1f5e424402bc]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:30:18 user nova-compute[86931]:   <uuid>4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</uuid>
Nov 16 19:30:18 user nova-compute[86931]:   <name>instance-00000012</name>
Nov 16 19:30:18 user nova-compute[86931]:   <memory>2097152</memory>
Nov 16 19:30:18 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:30:18 user nova-compute[86931]:   <metadata>
Nov 16 19:30:18 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:30:18 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherB-server-1168467223</nova:name>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:30:17</nova:creationTime>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:flavor name="m1.small">
Nov 16 19:30:18 user nova-compute[86931]:         <nova:memory>2048</nova:memory>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:disk>20</nova:disk>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:30:18 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:owner>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:user uuid="4a76c0f9be3748ab9891d17446fb9ee4">tempest-ServerActionsTestOtherB-1844657466-project-member</nova:user>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:project uuid="a8cd8e208b65450bbf83ee548609db34">tempest-ServerActionsTestOtherB-1844657466</nova:project>
Nov 16 19:30:18 user nova-compute[86931]:       </nova:owner>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:30:18 user nova-compute[86931]:       <nova:ports>
Nov 16 19:30:18 user nova-compute[86931]:         <nova:port uuid="ec0dd494-b4da-48ce-bfff-a77b0e3d2e69">
Nov 16 19:30:18 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:30:18 user nova-compute[86931]:         </nova:port>
Nov 16 19:30:18 user nova-compute[86931]:       </nova:ports>
Nov 16 19:30:18 user nova-compute[86931]:     </nova:instance>
Nov 16 19:30:18 user nova-compute[86931]:   </metadata>
Nov 16 19:30:18 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:30:18 user nova-compute[86931]:     <system>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="serial">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="uuid">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:30:18 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:30:18 user nova-compute[86931]:     </system>
Nov 16 19:30:18 user nova-compute[86931]:   </sysinfo>
Nov 16 19:30:18 user nova-compute[86931]:   <os>
Nov 16 19:30:18 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:30:18 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:30:18 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:30:18 user nova-compute[86931]:   </os>
Nov 16 19:30:18 user nova-compute[86931]:   <features>
Nov 16 19:30:18 user nova-compute[86931]:     <acpi/>
Nov 16 19:30:18 user nova-compute[86931]:     <apic/>
Nov 16 19:30:18 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:30:18 user nova-compute[86931]:   </features>
Nov 16 19:30:18 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:30:18 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:30:18 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:30:18 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:30:18 user nova-compute[86931]:   </clock>
Nov 16 19:30:18 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:30:18 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:30:18 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:30:18 user nova-compute[86931]:   </cpu>
Nov 16 19:30:18 user nova-compute[86931]:   <devices>
Nov 16 19:30:18 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:30:18 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:30:18 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk"/>
Nov 16 19:30:18 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:30:18 user nova-compute[86931]:     </disk>
Nov 16 19:30:18 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:30:18 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:18 user nova-compute[86931]:       <source dev="/dev/sde"/>
Nov 16 19:30:18 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:30:18 user nova-compute[86931]:       <serial>3bde119e-a77d-4827-ad77-02b4dbb12877</serial>
Nov 16 19:30:18 user nova-compute[86931]:     </disk>
Nov 16 19:30:18 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:30:18 user nova-compute[86931]:       <mac address="fa:16:3e:74:67:94"/>
Nov 16 19:30:18 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:18 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:30:18 user nova-compute[86931]:       <target dev="tapec0dd494-b4"/>
Nov 16 19:30:18 user nova-compute[86931]:     </interface>
Nov 16 19:30:18 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:30:18 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/console.log" append="off"/>
Nov 16 19:30:18 user nova-compute[86931]:     </serial>
Nov 16 19:30:18 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:30:18 user nova-compute[86931]:     <video>
Nov 16 19:30:18 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:18 user nova-compute[86931]:     </video>
Nov 16 19:30:18 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:30:18 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:30:18 user nova-compute[86931]:     </rng>
Nov 16 19:30:18 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:30:18 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:30:18 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:30:18 user nova-compute[86931]:     </memballoon>
Nov 16 19:30:18 user nova-compute[86931]:   </devices>
Nov 16 19:30:18 user nova-compute[86931]: </domain>
Nov 16 19:30:18 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-810179958-network", "vif_mac": "fa:16:3e:74:67:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG os_vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbac5be8-4db8-50ce-81d9-37d9ea182943', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec0dd494-b4, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec0dd494-b4, col_values=(('qos', UUID('80e097a1-4863-4709-85c6-843ff4c6c73e')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec0dd494-b4, col_values=(('external_ids', {'iface-id': 'ec0dd494-b4da-48ce-bfff-a77b0e3d2e69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:67:94', 'vm-uuid': '4dfb53cd-4239-4cea-80d5-ecd6ac8ed200'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:18 user nova-compute[86931]: INFO os_vif [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] No VIF found with MAC fa:16:3e:74:67:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:20 user nova-compute[86931]: WARNING nova.compute.manager [req-004692ae-a118-435e-bb5f-875150d3350a req-f085fe24-42ec-4b6e-a708-f7fdaf62dd4e service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state active and task_state resize_finish.
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:30:20 user nova-compute[86931]: INFO nova.compute.claims [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Claim successful on node user
Nov 16 19:30:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:30:21 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.policy [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c8c15e0597f411f81270cd3b181043b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97456514d9f541ec936e509c558e60db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:30:21 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Creating image(s)
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.229s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Successfully created port: 568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk 1073741824" returned: 0 in 0.054s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:30:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance running successfully.
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Failed to set time: agent not configured {{(pid=86931) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9ef26d19-bda7-403f-a831-80d35394b4e2 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] finish_migration finished successfully. {{(pid=86931) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Cannot resize image /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Ensure instance console log exists: /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:22 user nova-compute[86931]: WARNING nova.compute.manager [req-ae3c9e5d-2e18-4ac2-9de4-0f4ed8c32de5 req-bb51d4ca-a26f-4119-96e7-2fd5d974622a service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state active and task_state resize_finish.
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Successfully updated port: 568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-changed-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Refreshing instance network info cache due to event network-changed-568223df-c056-419d-8444-8dbab484fed3. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] Acquiring lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updating instance_info_cache with network_info: [{"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Instance network_info: |[{"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] Acquired lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Refreshing network info cache for port 568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Start _get_guest_xml network_info=[{"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:30:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1287445306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1287445306',id=22,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-amzmcm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:22Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=f8e118ca-5ace-4f2f-964d-9e9638950d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.objects.instance [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid f8e118ca-5ace-4f2f-964d-9e9638950d00 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:30:23 user nova-compute[86931]:   <uuid>f8e118ca-5ace-4f2f-964d-9e9638950d00</uuid>
Nov 16 19:30:23 user nova-compute[86931]:   <name>instance-00000016</name>
Nov 16 19:30:23 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:30:23 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:30:23 user nova-compute[86931]:   <metadata>
Nov 16 19:30:23 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:30:23 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1287445306</nova:name>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:30:23</nova:creationTime>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:30:23 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:30:23 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:owner>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:30:23 user nova-compute[86931]:       </nova:owner>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:30:23 user nova-compute[86931]:       <nova:ports>
Nov 16 19:30:23 user nova-compute[86931]:         <nova:port uuid="568223df-c056-419d-8444-8dbab484fed3">
Nov 16 19:30:23 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 19:30:23 user nova-compute[86931]:         </nova:port>
Nov 16 19:30:23 user nova-compute[86931]:       </nova:ports>
Nov 16 19:30:23 user nova-compute[86931]:     </nova:instance>
Nov 16 19:30:23 user nova-compute[86931]:   </metadata>
Nov 16 19:30:23 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:30:23 user nova-compute[86931]:     <system>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="serial">f8e118ca-5ace-4f2f-964d-9e9638950d00</entry>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="uuid">f8e118ca-5ace-4f2f-964d-9e9638950d00</entry>
Nov 16 19:30:23 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:30:23 user nova-compute[86931]:     </system>
Nov 16 19:30:23 user nova-compute[86931]:   </sysinfo>
Nov 16 19:30:23 user nova-compute[86931]:   <os>
Nov 16 19:30:23 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:30:23 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:30:23 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:30:23 user nova-compute[86931]:   </os>
Nov 16 19:30:23 user nova-compute[86931]:   <features>
Nov 16 19:30:23 user nova-compute[86931]:     <acpi/>
Nov 16 19:30:23 user nova-compute[86931]:     <apic/>
Nov 16 19:30:23 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:30:23 user nova-compute[86931]:   </features>
Nov 16 19:30:23 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:30:23 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:30:23 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:30:23 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:30:23 user nova-compute[86931]:   </clock>
Nov 16 19:30:23 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:30:23 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:30:23 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:30:23 user nova-compute[86931]:   </cpu>
Nov 16 19:30:23 user nova-compute[86931]:   <devices>
Nov 16 19:30:23 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:30:23 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:30:23 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk"/>
Nov 16 19:30:23 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:30:23 user nova-compute[86931]:     </disk>
Nov 16 19:30:23 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:30:23 user nova-compute[86931]:       <mac address="fa:16:3e:a8:d6:f9"/>
Nov 16 19:30:23 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:23 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:30:23 user nova-compute[86931]:       <target dev="tap568223df-c0"/>
Nov 16 19:30:23 user nova-compute[86931]:     </interface>
Nov 16 19:30:23 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:30:23 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/console.log" append="off"/>
Nov 16 19:30:23 user nova-compute[86931]:     </serial>
Nov 16 19:30:23 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:30:23 user nova-compute[86931]:     <video>
Nov 16 19:30:23 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:23 user nova-compute[86931]:     </video>
Nov 16 19:30:23 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:30:23 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:30:23 user nova-compute[86931]:     </rng>
Nov 16 19:30:23 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:30:23 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:30:23 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:30:23 user nova-compute[86931]:     </memballoon>
Nov 16 19:30:23 user nova-compute[86931]:   </devices>
Nov 16 19:30:23 user nova-compute[86931]: </domain>
Nov 16 19:30:23 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1287445306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1287445306',id=22,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-amzmcm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:22Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=f8e118ca-5ace-4f2f-964d-9e9638950d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG os_vif [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42b871eb-88e1-5a88-ad5a-d0446b852e8a', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap568223df-c0, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap568223df-c0, col_values=(('qos', UUID('3dc335a4-3295-436f-9e30-51cab14ccfc4')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap568223df-c0, col_values=(('external_ids', {'iface-id': '568223df-c056-419d-8444-8dbab484fed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:d6:f9', 'vm-uuid': 'f8e118ca-5ace-4f2f-964d-9e9638950d00'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:23 user nova-compute[86931]: INFO os_vif [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0')
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:a8:d6:f9, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updated VIF entry in instance network info cache for port 568223df-c056-419d-8444-8dbab484fed3. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updating instance_info_cache with network_info: [{"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a7908b72-d6fa-416e-87ce-21765b01f44a req-7f071dd2-57dd-4c3c-a0b5-8bd5361d86c2 service nova] Releasing lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:24 user nova-compute[86931]: INFO nova.compute.manager [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Detaching volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:30:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:24 user nova-compute[86931]: INFO nova.virt.block_device [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Attempting to driver detach volume ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 from mountpoint /dev/vdb
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Attempting to detach device vdb from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:30:24 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:24 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:30:24 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:30:24 user nova-compute[86931]:   <serial>ac40c1f1-9c78-4cc3-b65c-bfff18ca3501</serial>
Nov 16 19:30:24 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:30:24 user nova-compute[86931]: </disk>
Nov 16 19:30:24 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:30:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully detached device vdb from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the persistent domain config.
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:30:24 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:24 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:30:24 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:30:24 user nova-compute[86931]:   <serial>ac40c1f1-9c78-4cc3-b65c-bfff18ca3501</serial>
Nov 16 19:30:24 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:30:24 user nova-compute[86931]: </disk>
Nov 16 19:30:24 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] No waiting events found dispatching network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:24 user nova-compute[86931]: WARNING nova.compute.manager [req-9e244c9b-c5b2-49ae-831a-caeae187b411 req-3e420660-0e98-4a6e-9191-7938f1359384 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received unexpected event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 for instance with vm_state building and task_state spawning.
Nov 16 19:30:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:30:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] No waiting events found dispatching network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:30:27 user nova-compute[86931]: WARNING nova.compute.manager [req-e6f63308-501f-4bb3-9f0e-5367ea1f9c3d req-9c102007-f0dc-4436-9e6f-4603f2c14663 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received unexpected event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 for instance with vm_state building and task_state spawning.
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:30:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Instance spawned successfully.
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:30:27 user nova-compute[86931]: INFO nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 16 19:30:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:30:27 user nova-compute[86931]: INFO nova.compute.manager [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Took 6.64 seconds to build instance.
Nov 16 19:30:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-742f510d-5f21-4bdb-aafa-0e22876830ad tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-changed-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Refreshing instance network info cache due to event network-changed-48e98eab-1914-45c5-8d77-e0ef29c397ad. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] Acquiring lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] Acquired lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:38 user nova-compute[86931]: DEBUG nova.network.neutron [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Refreshing network info cache for port 48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:30:39 user nova-compute[86931]: DEBUG nova.network.neutron [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updated VIF entry in instance network info cache for port 48e98eab-1914-45c5-8d77-e0ef29c397ad. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:30:39 user nova-compute[86931]: DEBUG nova.network.neutron [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updating instance_info_cache with network_info: [{"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-736c1874-c8b7-48be-867c-0e6f3ae9abcd req-f2f86d69-9fdb-4279-b129-3b8da1b2f236 service nova] Releasing lock "refresh_cache-1e19b001-5671-4298-a979-9fe267b9efcd" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:30:44 user nova-compute[86931]: INFO nova.compute.claims [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Claim successful on node user
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:30:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:30:45 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 is timed out.
Nov 16 19:30:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully detached device vdb from instance 3a3edd48-2e72-4195-a366-06ec5e34b496 from the live domain config.
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxJcTavX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:45 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d296164-70df-495b-a706-a2152827c0bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:30:45 user nova-compute[86931]: No targets found.
Nov 16 19:30:45 user nova-compute[86931]: iSNS:
Nov 16 19:30:45 user nova-compute[86931]: No targets found.
Nov 16 19:30:45 user nova-compute[86931]: STATIC:
Nov 16 19:30:45 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:30:45 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:45 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:45 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:30:45 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:45 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:45 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:30:45 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:45 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:45 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501
Nov 16 19:30:45 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:45 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:45 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:30:45 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:30:45 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:30:45 user nova-compute[86931]: FIRMWARE:
Nov 16 19:30:45 user nova-compute[86931]: No targets found.
Nov 16 19:30:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:30:45 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:30:45 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.902s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[10828c12-3590-4b45-ae3e-5a83abc9eecf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8ffad-b871-4f08-9e69-122cccf0be2b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:45 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c33a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501'): ({'sdh'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Removing single pathed devices sdh {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[789bb6b8-a9ad-4360-9e03-c620d5cca2e6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc05e0c-3fc7-402a-9948-27e2025a4bbb]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flushing IO for device /dev/sdh {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11d8a30-46f7-412f-99f7-e8ac76c6fddf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9843f3-591c-4606-904d-a1009142845f]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.policy [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:30:45 user nova-compute[86931]: INFO nova.virt.block_device [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Booting with volume snapshot 727e03a5-d1ac-450b-9477-1dea6328fbab at /dev/vda
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e0769-cd0c-4c53-be1e-d87bb0bcee59]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[54046e8b-139c-4e50-a114-de73df9a0802]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260]
Nov 16 19:30:45 user nova-compute[86931]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501, portal: 172.16.0.220,3260] successful.
Nov 16 19:30:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac40c1f1-9c78-4cc3-b65c-bfff18ca3501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ce993-e305-4d62-bd89-f8e62c4c59b8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== disconnect_volume: return (452ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Successfully created port: 85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'flavor' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0746d57b-c62d-42ab-8852-99f10e5eaf8c tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.397s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Successfully updated port: 85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-changed-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Refreshing instance network info cache due to event network-changed-85affde0-a55e-48c9-a756-a6ffae26ced3. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] Acquiring lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updating instance_info_cache with network_info: [{"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Instance network_info: |[{"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] Acquired lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.network.neutron [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Refreshing network info cache for port 85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updated VIF entry in instance network info cache for port 85affde0-a55e-48c9-a756-a6ffae26ced3. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updating instance_info_cache with network_info: [{"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:30:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=25.16446304321289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fb889940-e562-4145-8908-90fe8d0642e9 req-5c998df1-a06f-4e1a-9211-2d012bac8897 service nova] Releasing lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Applying migration context for instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 as it has an incoming, in-progress migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd. Migration status is finished {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 19:30:48 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating resource usage from migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3a3edd48-2e72-4195-a366-06ec5e34b496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 1e19b001-5671-4298-a979-9fe267b9efcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 173a94e7-b610-490f-80b4-432cad8f5c9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:30:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.utils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd07fb46-da59-4073-91ca-f930974c0356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6887d4-4d8f-4a14-948e-d83732e28bca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2bcdf-d487-4006-98d0-847615cfd6aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce281982-c3ba-4f51-b4c7-528f7813c2ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:30:51 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:30:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[819dbc23-521b-42d6-aa3f-68f16bcbd381]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG os_brick.utils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updating existing volume attachment record: 38c25692-9d8f-45e3-8a75-fe7ba99051d6 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:30:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:30:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Creating image(s)
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Ensure instance console log exists: /opt/stack/data/nova/instances/173a94e7-b610-490f-80b4-432cad8f5c9b/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Start _get_guest_xml network_info=[{"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T19:30:40Z,direct_url=<?>,disk_format='qcow2',id=c71d10d0-c5b2-47a6-b2ea-52658d2172db,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-845864401',owner='4ae1bbd144fb4a83988126b487c7874c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T19:30:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '38c25692-9d8f-45e3-8a75-fe7ba99051d6', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eInwobTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '173a94e7-b610-490f-80b4-432cad8f5c9b', 'attached_at': '', 'detached_at': '', 'volume_id': '973d2283-5651-440d-87eb-7fbf74dc7d26', 'serial': '973d2283-5651-440d-87eb-7fbf74dc7d26'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:30:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T19:30:40Z,direct_url=<?>,disk_format='qcow2',id=c71d10d0-c5b2-47a6-b2ea-52658d2172db,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-845864401',owner='4ae1bbd144fb4a83988126b487c7874c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T19:30:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eInwobTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:30:57 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:57 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:30:57 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c899e2-cd9c-420b-abf2-1464c97a4563]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:30:57 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b8949-76d7-4182-adb7-8c31a569eafd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26] added
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b030c0c-6291-48fd-a26c-da0b57181e2e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[68931b5e-113b-47e6-bbcc-cb9eac47cfe3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eInwobTc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eInwobTc" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872f0ff-6156-4ad7-85d4-2b7137205d3b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eInwobTc'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c52ad2-a02c-4702-8bc5-481172c45c79]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708d1e8-5e9d-47f8-9942-cc2500c23394]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --login" returned: 0 in 0.141s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a495218-ac13-4692-a9e0-53d9901aff69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260]
Nov 16 19:30:57 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260] successful.
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63ecd9-beb2-4eea-a3ff-9df68e42a8c7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b6795-3ebc-4c98-a35e-3286a33d3169]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:30:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[68746f10-f7c3-42d5-a84d-91fafa76aa34]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:30:57 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eInwobTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26461316239376136', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461316239376136', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2109974625',id=23,image_ref='c71d10d0-c5b2-47a6-b2ea-52658d2172db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkKh+jqx5q5c2/lw7tGr6exf258eG6qKYW3MIV8CL32tVgCkaffiuFqHCzyFsO6VjvmI7jqVkRavOqRUmPeEQRk+2AOlT6YeKODA1gscE26ltK5bJiQE3DcnoWBt/w29g==',key_name='tempest-keypair-552034726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-uzr1m2i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1009954453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=173a94e7-b610-490f-80b4-432cad8f5c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid 173a94e7-b610-490f-80b4-432cad8f5c9b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:30:58 user nova-compute[86931]:   <uuid>173a94e7-b610-490f-80b4-432cad8f5c9b</uuid>
Nov 16 19:30:58 user nova-compute[86931]:   <name>instance-00000017</name>
Nov 16 19:30:58 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:30:58 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:30:58 user nova-compute[86931]:   <metadata>
Nov 16 19:30:58 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:30:58 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2109974625</nova:name>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:30:57</nova:creationTime>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:30:58 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:30:58 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:owner>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:30:58 user nova-compute[86931]:       </nova:owner>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:root type="image" uuid="c71d10d0-c5b2-47a6-b2ea-52658d2172db"/>
Nov 16 19:30:58 user nova-compute[86931]:       <nova:ports>
Nov 16 19:30:58 user nova-compute[86931]:         <nova:port uuid="85affde0-a55e-48c9-a756-a6ffae26ced3">
Nov 16 19:30:58 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:30:58 user nova-compute[86931]:         </nova:port>
Nov 16 19:30:58 user nova-compute[86931]:       </nova:ports>
Nov 16 19:30:58 user nova-compute[86931]:     </nova:instance>
Nov 16 19:30:58 user nova-compute[86931]:   </metadata>
Nov 16 19:30:58 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:30:58 user nova-compute[86931]:     <system>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="serial">173a94e7-b610-490f-80b4-432cad8f5c9b</entry>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="uuid">173a94e7-b610-490f-80b4-432cad8f5c9b</entry>
Nov 16 19:30:58 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:30:58 user nova-compute[86931]:     </system>
Nov 16 19:30:58 user nova-compute[86931]:   </sysinfo>
Nov 16 19:30:58 user nova-compute[86931]:   <os>
Nov 16 19:30:58 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:30:58 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:30:58 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:30:58 user nova-compute[86931]:   </os>
Nov 16 19:30:58 user nova-compute[86931]:   <features>
Nov 16 19:30:58 user nova-compute[86931]:     <acpi/>
Nov 16 19:30:58 user nova-compute[86931]:     <apic/>
Nov 16 19:30:58 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:30:58 user nova-compute[86931]:   </features>
Nov 16 19:30:58 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:30:58 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:30:58 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:30:58 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:30:58 user nova-compute[86931]:   </clock>
Nov 16 19:30:58 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:30:58 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:30:58 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:30:58 user nova-compute[86931]:   </cpu>
Nov 16 19:30:58 user nova-compute[86931]:   <devices>
Nov 16 19:30:58 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:30:58 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:30:58 user nova-compute[86931]:       <source dev="/dev/sdf"/>
Nov 16 19:30:58 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:30:58 user nova-compute[86931]:       <serial>973d2283-5651-440d-87eb-7fbf74dc7d26</serial>
Nov 16 19:30:58 user nova-compute[86931]:     </disk>
Nov 16 19:30:58 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:30:58 user nova-compute[86931]:       <mac address="fa:16:3e:5b:7c:f2"/>
Nov 16 19:30:58 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:58 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:30:58 user nova-compute[86931]:       <target dev="tap85affde0-a5"/>
Nov 16 19:30:58 user nova-compute[86931]:     </interface>
Nov 16 19:30:58 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:30:58 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/173a94e7-b610-490f-80b4-432cad8f5c9b/console.log" append="off"/>
Nov 16 19:30:58 user nova-compute[86931]:     </serial>
Nov 16 19:30:58 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:30:58 user nova-compute[86931]:     <video>
Nov 16 19:30:58 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:30:58 user nova-compute[86931]:     </video>
Nov 16 19:30:58 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:30:58 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:30:58 user nova-compute[86931]:     </rng>
Nov 16 19:30:58 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:30:58 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:30:58 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:30:58 user nova-compute[86931]:     </memballoon>
Nov 16 19:30:58 user nova-compute[86931]:   </devices>
Nov 16 19:30:58 user nova-compute[86931]: </domain>
Nov 16 19:30:58 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2109974625',id=23,image_ref='c71d10d0-c5b2-47a6-b2ea-52658d2172db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkKh+jqx5q5c2/lw7tGr6exf258eG6qKYW3MIV8CL32tVgCkaffiuFqHCzyFsO6VjvmI7jqVkRavOqRUmPeEQRk+2AOlT6YeKODA1gscE26ltK5bJiQE3DcnoWBt/w29g==',key_name='tempest-keypair-552034726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-uzr1m2i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1009954453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=173a94e7-b610-490f-80b4-432cad8f5c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG os_vif [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1c4e3d8-64a8-54ad-b951-3bf50699e006', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85affde0-a5, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85affde0-a5, col_values=(('qos', UUID('43728316-151f-4a3b-b81a-302311066fe3')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85affde0-a5, col_values=(('external_ids', {'iface-id': '85affde0-a55e-48c9-a756-a6ffae26ced3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:7c:f2', 'vm-uuid': '173a94e7-b610-490f-80b4-432cad8f5c9b'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:30:59 user nova-compute[86931]: INFO os_vif [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5')
Nov 16 19:30:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:30:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:5b:7c:f2, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] No waiting events found dispatching network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:00 user nova-compute[86931]: WARNING nova.compute.manager [req-809c45f3-a78d-4480-a5f9-df7f01ec3207 req-a7bedbe4-3c64-48a6-8486-8dc8b7e31b7c service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received unexpected event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 for instance with vm_state building and task_state spawning.
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:31:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Instance spawned successfully.
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] No waiting events found dispatching network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:02 user nova-compute[86931]: WARNING nova.compute.manager [req-698c3371-27b5-4a8f-a36b-5ec51c9797a2 req-7106b62c-7ef3-4529-98aa-e2ac909c0123 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received unexpected event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 for instance with vm_state building and task_state spawning.
Nov 16 19:31:02 user nova-compute[86931]: INFO nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 16 19:31:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:31:02 user nova-compute[86931]: INFO nova.compute.manager [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Took 18.14 seconds to build instance.
Nov 16 19:31:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b0bb6bce-621c-42d6-86ed-8a28e1f5c014 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.237s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:14 user nova-compute[86931]: INFO nova.compute.manager [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Terminating instance
Nov 16 19:31:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-cdc980f1-1c8b-45af-a52f-1a66903a18a7 req-b0d83525-9909-45b3-a3c1-653e4c088669 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Instance destroyed successfully.
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'resources' on Instance uuid 3a3edd48-2e72-4195-a366-06ec5e34b496 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1491216944',display_name='tempest-ServerActionsTestOtherA-server-757406422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1491216944',id=14,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwoc+xCFrHkrw8Xt2I7VtoM7R6gFkU2MV0kR6+M4vUT0O/w1pmpUY1KnTnnmo0GVHLqiSgNiQG83rxKHI/cp9+mDa0bJ+9KfdaX4mUv+HO9+2jA9XDzrNsZHx+QhnMRqg==',key_name='tempest-keypair-1361413423',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-tn8v3er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:27:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=3a3edd48-2e72-4195-a366-06ec5e34b496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "address": "fa:16:3e:4f:4c:61", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d53c11-d1", "ovs_interfaceid": "62d53c11-d15d-4af9-a560-8911e3dcaeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG os_vif [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d53c11-d1, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f51223a-ea00-4827-9199-85629586432c) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:15 user nova-compute[86931]: INFO os_vif [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:4c:61,bridge_name='br-int',has_traffic_filtering=True,id=62d53c11-d15d-4af9-a560-8911e3dcaeb9,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d53c11-d1')
Nov 16 19:31:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Deleting instance files /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496_del
Nov 16 19:31:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Deletion of /opt/stack/data/nova/instances/3a3edd48-2e72-4195-a366-06ec5e34b496_del complete
Nov 16 19:31:15 user nova-compute[86931]: INFO nova.compute.manager [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 19:31:15 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:31:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:16 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:16 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Took 0.98 seconds to deallocate network for instance.
Nov 16 19:31:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:17 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Deleted allocations for instance 3a3edd48-2e72-4195-a366-06ec5e34b496
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:17 user nova-compute[86931]: WARNING nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state deleted and task_state None.
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:17 user nova-compute[86931]: WARNING nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state deleted and task_state None.
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:17 user nova-compute[86931]: WARNING nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state deleted and task_state None.
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:17 user nova-compute[86931]: WARNING nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-unplugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state deleted and task_state None.
Nov 16 19:31:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-673c4a70-e9dd-4cbf-9afa-176085029745 req-19756c4e-f5f6-4766-a973-0960e651e721 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-deleted-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3f65b1fd-1264-4bb6-b201-283829d1d39a tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.457s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] Acquiring lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] Lock "3a3edd48-2e72-4195-a366-06ec5e34b496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] No waiting events found dispatching network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:19 user nova-compute[86931]: WARNING nova.compute.manager [req-2faaa461-74fd-4114-84c5-b475f036530b req-98f3ead2-f700-4bc7-a11f-f96ab218b065 service nova] [instance: 3a3edd48-2e72-4195-a366-06ec5e34b496] Received unexpected event network-vif-plugged-62d53c11-d15d-4af9-a560-8911e3dcaeb9 for instance with vm_state deleted and task_state None.
Nov 16 19:31:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:30 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:31:30 user nova-compute[86931]: INFO nova.compute.claims [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Claim successful on node user
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:31:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.policy [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c4e8c35419648338cc81c64a9e1fef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501231dd92fd4ad0ba93e6d5c1f99394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:31:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Creating image(s)
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "/opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "/opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.166s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk 1073741824" returned: 0 in 0.104s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Successfully created port: 1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Cannot resize image /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Ensure instance console log exists: /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Successfully updated port: 1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquired lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-changed-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Refreshing instance network info cache due to event network-changed-1fe5f2e1-f3a1-4ef0-8502-251147e0b400. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] Acquiring lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating instance_info_cache with network_info: [{"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Releasing lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Instance network_info: |[{"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] Acquired lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Refreshing network info cache for port 1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Start _get_guest_xml network_info=[{"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:31:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:31:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1498521135',display_name='tempest-SnapshotDataIntegrityTests-server-1498521135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1498521135',id=24,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJJJM4hrNGsz9saVxTFgl1KPxeqWquQgfdrHnf/MfcbUpL4Obtn0BtWZCHh/qRZcDP5RQneO9AnvXtu7qxq/sZ2rVXTdK+hzVDWzpC31nYVhCm8wyCogc3NfFp/pGSz7w==',key_name='tempest-keypair-1841072874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='501231dd92fd4ad0ba93e6d5c1f99394',ramdisk_id='',reservation_id='r-n01gg0uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-408275298',owner_user_name='tempest-SnapshotDataIntegrityTests-408275298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c4e8c35419648338cc81c64a9e1fef6',uuid=a6231ab3-ae23-4b87-926c-86fd9e0a357b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converting VIF {"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.objects.instance [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'pci_devices' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:31:33 user nova-compute[86931]:   <uuid>a6231ab3-ae23-4b87-926c-86fd9e0a357b</uuid>
Nov 16 19:31:33 user nova-compute[86931]:   <name>instance-00000018</name>
Nov 16 19:31:33 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:31:33 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:31:33 user nova-compute[86931]:   <metadata>
Nov 16 19:31:33 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:31:33 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1498521135</nova:name>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:31:33</nova:creationTime>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:31:33 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:31:33 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:owner>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:user uuid="6c4e8c35419648338cc81c64a9e1fef6">tempest-SnapshotDataIntegrityTests-408275298-project-member</nova:user>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:project uuid="501231dd92fd4ad0ba93e6d5c1f99394">tempest-SnapshotDataIntegrityTests-408275298</nova:project>
Nov 16 19:31:33 user nova-compute[86931]:       </nova:owner>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:31:33 user nova-compute[86931]:       <nova:ports>
Nov 16 19:31:33 user nova-compute[86931]:         <nova:port uuid="1fe5f2e1-f3a1-4ef0-8502-251147e0b400">
Nov 16 19:31:33 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:31:33 user nova-compute[86931]:         </nova:port>
Nov 16 19:31:33 user nova-compute[86931]:       </nova:ports>
Nov 16 19:31:33 user nova-compute[86931]:     </nova:instance>
Nov 16 19:31:33 user nova-compute[86931]:   </metadata>
Nov 16 19:31:33 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:31:33 user nova-compute[86931]:     <system>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="serial">a6231ab3-ae23-4b87-926c-86fd9e0a357b</entry>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="uuid">a6231ab3-ae23-4b87-926c-86fd9e0a357b</entry>
Nov 16 19:31:33 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:31:33 user nova-compute[86931]:     </system>
Nov 16 19:31:33 user nova-compute[86931]:   </sysinfo>
Nov 16 19:31:33 user nova-compute[86931]:   <os>
Nov 16 19:31:33 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:31:33 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:31:33 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:31:33 user nova-compute[86931]:   </os>
Nov 16 19:31:33 user nova-compute[86931]:   <features>
Nov 16 19:31:33 user nova-compute[86931]:     <acpi/>
Nov 16 19:31:33 user nova-compute[86931]:     <apic/>
Nov 16 19:31:33 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:31:33 user nova-compute[86931]:   </features>
Nov 16 19:31:33 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:31:33 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:31:33 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:31:33 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:31:33 user nova-compute[86931]:   </clock>
Nov 16 19:31:33 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:31:33 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:31:33 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:31:33 user nova-compute[86931]:   </cpu>
Nov 16 19:31:33 user nova-compute[86931]:   <devices>
Nov 16 19:31:33 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:31:33 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:31:33 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk"/>
Nov 16 19:31:33 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:31:33 user nova-compute[86931]:     </disk>
Nov 16 19:31:33 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:31:33 user nova-compute[86931]:       <mac address="fa:16:3e:63:da:94"/>
Nov 16 19:31:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:31:33 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:31:33 user nova-compute[86931]:       <target dev="tap1fe5f2e1-f3"/>
Nov 16 19:31:33 user nova-compute[86931]:     </interface>
Nov 16 19:31:33 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:31:33 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/console.log" append="off"/>
Nov 16 19:31:33 user nova-compute[86931]:     </serial>
Nov 16 19:31:33 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:31:33 user nova-compute[86931]:     <video>
Nov 16 19:31:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:31:33 user nova-compute[86931]:     </video>
Nov 16 19:31:33 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:31:33 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:31:33 user nova-compute[86931]:     </rng>
Nov 16 19:31:33 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:31:33 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:31:33 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:31:33 user nova-compute[86931]:     </memballoon>
Nov 16 19:31:33 user nova-compute[86931]:   </devices>
Nov 16 19:31:33 user nova-compute[86931]: </domain>
Nov 16 19:31:33 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1498521135',display_name='tempest-SnapshotDataIntegrityTests-server-1498521135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1498521135',id=24,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJJJM4hrNGsz9saVxTFgl1KPxeqWquQgfdrHnf/MfcbUpL4Obtn0BtWZCHh/qRZcDP5RQneO9AnvXtu7qxq/sZ2rVXTdK+hzVDWzpC31nYVhCm8wyCogc3NfFp/pGSz7w==',key_name='tempest-keypair-1841072874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='501231dd92fd4ad0ba93e6d5c1f99394',ramdisk_id='',reservation_id='r-n01gg0uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-408275298',owner_user_name='tempest-SnapshotDataIntegrityTests-408275298-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:31:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c4e8c35419648338cc81c64a9e1fef6',uuid=a6231ab3-ae23-4b87-926c-86fd9e0a357b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converting VIF {"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG os_vif [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9921c882-f622-591a-af61-8cb88d1e416d', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fe5f2e1-f3, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fe5f2e1-f3, col_values=(('qos', UUID('f23f88de-a4a0-4ef8-bde8-ab9c3870f6d2')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fe5f2e1-f3, col_values=(('external_ids', {'iface-id': '1fe5f2e1-f3a1-4ef0-8502-251147e0b400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:da:94', 'vm-uuid': 'a6231ab3-ae23-4b87-926c-86fd9e0a357b'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:33 user nova-compute[86931]: INFO os_vif [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3')
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No VIF found with MAC fa:16:3e:63:da:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updated VIF entry in instance network info cache for port 1fe5f2e1-f3a1-4ef0-8502-251147e0b400. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating instance_info_cache with network_info: [{"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1f4197da-f7a5-4909-8556-34c90adb955f req-29e61ec1-ed3d-4260-bd4a-5ec515faea24 service nova] Releasing lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:34 user nova-compute[86931]: INFO nova.compute.manager [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Terminating instance
Nov 16 19:31:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-1c187a84-2af0-4b36-8e99-408dd3fa901d req-704fda5e-f2bc-4964-b2eb-8e123b92a38c service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-unplugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:31:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Instance destroyed successfully.
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.objects.instance [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'resources' on Instance uuid 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-617281987',display_name='tempest-AttachVolumeTestJSON-server-617281987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-617281987',id=2,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjl6u7SpSDUl9dugXV/2HxVWXR8P2McIwc0BuEuJO6tCN8NRUqYjgqKGBLmTK+tLiAeRkEY7s3a1kVd8X++nofufo9PB65XUelFh+I1etl1kTTqepEsP2OqMoXms0zPqA==',key_name='tempest-keypair-678612419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:21:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-02nvzqbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=08ef1b8a-6ff3-4322-b9ea-7ca7e838a829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "address": "fa:16:3e:00:91:45", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b4eea3-5c", "ovs_interfaceid": "81b4eea3-5c4e-4a28-8c21-51adc18be286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG os_vif [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b4eea3-5c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2c17537-f395-47c5-ad78-29cf494934d0) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:35 user nova-compute[86931]: INFO os_vif [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:91:45,bridge_name='br-int',has_traffic_filtering=True,id=81b4eea3-5c4e-4a28-8c21-51adc18be286,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b4eea3-5c')
Nov 16 19:31:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Deleting instance files /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829_del
Nov 16 19:31:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Deletion of /opt/stack/data/nova/instances/08ef1b8a-6ff3-4322-b9ea-7ca7e838a829_del complete
Nov 16 19:31:35 user nova-compute[86931]: INFO nova.compute.manager [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 16 19:31:35 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:31:35 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:36 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Took 0.67 seconds to deallocate network for instance.
Nov 16 19:31:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad99407c-66d5-4b19-950e-8ac389b31f2e req-1deda108-2f48-4eb4-80c7-d3f246fa7b6d service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-deleted-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:36 user nova-compute[86931]: INFO nova.compute.manager [req-ad99407c-66d5-4b19-950e-8ac389b31f2e req-1deda108-2f48-4eb4-80c7-d3f246fa7b6d service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Neutron deleted interface 81b4eea3-5c4e-4a28-8c21-51adc18be286; detaching it from the instance and deleting it from the info cache
Nov 16 19:31:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-ad99407c-66d5-4b19-950e-8ac389b31f2e req-1deda108-2f48-4eb4-80c7-d3f246fa7b6d service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad99407c-66d5-4b19-950e-8ac389b31f2e req-1deda108-2f48-4eb4-80c7-d3f246fa7b6d service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Detach interface failed, port_id=81b4eea3-5c4e-4a28-8c21-51adc18be286, reason: Instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:37 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Deleted allocations for instance 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45e174c1-e63d-4a5e-afab-8737ea0d17e9 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Acquiring lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "08ef1b8a-6ff3-4322-b9ea-7ca7e838a829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] No waiting events found dispatching network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:37 user nova-compute[86931]: WARNING nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: 08ef1b8a-6ff3-4322-b9ea-7ca7e838a829] Received unexpected event network-vif-plugged-81b4eea3-5c4e-4a28-8c21-51adc18be286 for instance with vm_state deleted and task_state None.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] No waiting events found dispatching network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:37 user nova-compute[86931]: WARNING nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received unexpected event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 for instance with vm_state building and task_state spawning.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] No waiting events found dispatching network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:37 user nova-compute[86931]: WARNING nova.compute.manager [req-888ea11b-ed7e-49ce-aea1-bfa88d7888eb req-7e9bed3e-aefb-4c32-b8fe-4826739b1b11 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received unexpected event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 for instance with vm_state building and task_state spawning.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:31:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Instance spawned successfully.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:31:37 user nova-compute[86931]: INFO nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:31:37 user nova-compute[86931]: INFO nova.compute.manager [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Took 7.00 seconds to build instance.
Nov 16 19:31:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-029d25d5-bb9b-4f20-890a-67b6e9065704 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.172s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:31:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:31:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:31:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=25.205291748046875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:48 user nova-compute[86931]: INFO nova.compute.manager [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Unrescuing
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Applying migration context for instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 as it has an incoming, in-progress migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd. Migration status is finished {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 19:31:48 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating resource usage from migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 1e19b001-5671-4298-a979-9fe267b9efcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 173a94e7-b610-490f-80b4-432cad8f5c9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG nova.objects.instance [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'flavor' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:49 user nova-compute[86931]: WARNING nova.compute.manager [req-ad9adae3-6b9d-4896-8937-feddb3bf1a53 req-d01a9b4d-b9bd-443f-a3a6-2da760d77166 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:31:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance destroyed successfully.
Nov 16 19:31:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing instance network info cache due to event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:31:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updated VIF entry in instance network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:31:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e35b74f-73e9-4156-bd40-dd2c85469c4d req-e53cf0e9-5b3f-47da-8495-6bc591c689f2 service nova] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:51 user nova-compute[86931]: WARNING nova.compute.manager [req-152f57eb-64da-4f59-b2a1-2c2b9d724b3e req-e3d6018f-f11f-4810-94ac-4aa8b4a3e8c7 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing instance network info cache due to event network-changed-8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] Acquiring lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] Acquired lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Refreshing network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updated VIF entry in instance network info cache for port 8997ab3d-23ec-4b9b-8743-8269f35eb4a0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:31:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [{"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b818f2cc-e24a-403b-9d35-689fac8be42c req-8d0c881e-960b-4787-928c-1d7a52ba514f service nova] Releasing lock "refresh_cache-3b54f114-2b97-4b0b-9149-06347861d653" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-515ebc14-5d80-4c01-a080-0e7c77112ca3 tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:53 user nova-compute[86931]: WARNING nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state None.
Nov 16 19:31:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:53 user nova-compute[86931]: WARNING nova.compute.manager [req-b3d4da6d-934e-4c82-bb45-c05ced94242e req-98de9c9f-df4b-4572-8d6b-c18785993897 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state active and task_state None.
Nov 16 19:31:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Port ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 binding to destination host user is already ACTIVE {{(pid=86931) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Creating tmpfile /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/tmp1lx5mq3u to verify with other compute node that the instance is on the same shared storage. {{(pid=86931) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:56 user nova-compute[86931]: WARNING nova.compute.manager [req-711f65e0-5954-47c6-8b6c-56c3d18c083f req-9d132f88-c80a-41d3-9e49-bc46655054a1 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state resized and task_state resize_reverting.
Nov 16 19:31:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance destroyed successfully.
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'resources' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:30:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec0dd494-b4, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80e097a1-4863-4709-85c6-843ff4c6c73e) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:31:56 user nova-compute[86931]: INFO os_vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:31:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:31:56 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99c44d-49fe-49f8-8ed3-3aec2584c082]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:31:56 user nova-compute[86931]: No targets found.
Nov 16 19:31:56 user nova-compute[86931]: iSNS:
Nov 16 19:31:56 user nova-compute[86931]: No targets found.
Nov 16 19:31:56 user nova-compute[86931]: STATIC:
Nov 16 19:31:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:31:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:31:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:31:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:31:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:31:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:31:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:31:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:31:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:31:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26
Nov 16 19:31:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:31:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:31:56 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:31:56 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:31:56 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:31:56 user nova-compute[86931]: FIRMWARE:
Nov 16 19:31:56 user nova-compute[86931]: No targets found.
Nov 16 19:31:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:31:56 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:31:56 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d318f-54ed-45d3-8439-bdbdf5bd87ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe2b951-3b4f-41ed-bf49-2ae3b124122c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:31:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c18a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c86fe55-6f38-4014-af14-b134ff866d9a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[12279053-94ce-4823-9b13-1537dc9603a5]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47feab9c-5bc0-4626-bfd6-66449a9dd8ed]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4703b811-3ba6-40b4-8387-979a836e117a]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:31:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e74e1d1-1ff6-4ea6-8ae3-8e0f828947ef]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[40482f33-a47e-4e4c-8932-3c3ae5f5c8f4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:31:57 user nova-compute[86931]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:31:57 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a740991-64e7-4fbf-942d-afde4cd40144]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== disconnect_volume: return (311ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:31:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'migration_context' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.objects.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Object Instance<4dfb53cd-4239-4cea-80d5-ecd6ac8ed200> lazy-loaded attributes: resources,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:31:58 user nova-compute[86931]: WARNING nova.compute.manager [req-2292e9d9-f70f-45bc-8cbb-098d523970ba req-b39be2bd-087f-48c9-88a1-80ad50c7d5e7 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state resized and task_state resize_reverting.
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.537s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:31:58 user nova-compute[86931]: INFO nova.compute.manager [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Swapping old allocation on dict_keys(['3324bc2c-db45-464f-b02b-15105785d59f']) held by migration 80bba105-6010-4e5b-b8fd-0ddb82bb8bfd for instance
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Overwriting current allocation {'allocations': {'3324bc2c-db45-464f-b02b-15105785d59f': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': 'a8cd8e208b65450bbf83ee548609db34', 'user_id': '4a76c0f9be3748ab9891d17446fb9ee4', 'consumer_generation': 1} on consumer 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:31:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.utils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[feec791d-e3fe-45f4-9732-d3681f28a2fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cbcc08-29ea-4e24-b543-96cc067de134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48489a7-7df9-4968-8b81-0ce702381a46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80bb99-e550-4cdc-9d94-8c040791d586]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:31:59 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:31:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb2ccc4-4958-4bc2-9cc6-b59315cd2089]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:31:59 user nova-compute[86931]: DEBUG os_brick.utils [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:32:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Starting finish_revert_migration {{(pid=86931) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start _get_guest_xml network_info=[{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '3d85ea29-213a-4070-b2da-a32016cd8945', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4dfb53cd-4239-4cea-80d5-ecd6ac8ed200', 'attached_at': '2023-11-16T19:32:05.000000', 'detached_at': '', 'volume_id': '3bde119e-a77d-4827-ad77-02b4dbb12877', 'serial': '3bde119e-a77d-4827-ad77-02b4dbb12877'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:32:04 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:04 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:32:04 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:32:04 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:32:04 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f1946-bc63-41a0-975d-cf7ab4fd4b24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:32:04 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faeb7c9-7d07-4ede-b7ae-00fc83878d98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877] added
Nov 16 19:32:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec63e8-c19d-4260-9030-864aae08e2db]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7865a71-2b8a-44f3-81f5-d7475eee8226]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XzuqynsB" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022da8e-fe03-4732-b5c7-8ca40438e7e7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XzuqynsB'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa3a7f-f713-42d8-b9a6-e99d7e3f673f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62cd17-fb1d-45b2-bb11-ec2cc5bb60ad]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[556f4fbf-4154-445b-959d-ac6911d7c83a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:32:05 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:32:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d1344-704e-4409-8766-e1cd23665f36]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f592527b-ea6c-4184-a5ba-4df6f849afac]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:05 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5139f-3cb5-433f-a055-6a4fbd2eeb49]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:32:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336562366539', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:32:06 user nova-compute[86931]:   <uuid>4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</uuid>
Nov 16 19:32:06 user nova-compute[86931]:   <name>instance-00000012</name>
Nov 16 19:32:06 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:32:06 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:32:06 user nova-compute[86931]:   <metadata>
Nov 16 19:32:06 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:32:06 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherB-server-1168467223</nova:name>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:32:04</nova:creationTime>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:32:06 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:32:06 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:owner>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:user uuid="4a76c0f9be3748ab9891d17446fb9ee4">tempest-ServerActionsTestOtherB-1844657466-project-member</nova:user>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:project uuid="a8cd8e208b65450bbf83ee548609db34">tempest-ServerActionsTestOtherB-1844657466</nova:project>
Nov 16 19:32:06 user nova-compute[86931]:       </nova:owner>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:32:06 user nova-compute[86931]:       <nova:ports>
Nov 16 19:32:06 user nova-compute[86931]:         <nova:port uuid="ec0dd494-b4da-48ce-bfff-a77b0e3d2e69">
Nov 16 19:32:06 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:32:06 user nova-compute[86931]:         </nova:port>
Nov 16 19:32:06 user nova-compute[86931]:       </nova:ports>
Nov 16 19:32:06 user nova-compute[86931]:     </nova:instance>
Nov 16 19:32:06 user nova-compute[86931]:   </metadata>
Nov 16 19:32:06 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:32:06 user nova-compute[86931]:     <system>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="serial">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="uuid">4dfb53cd-4239-4cea-80d5-ecd6ac8ed200</entry>
Nov 16 19:32:06 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:32:06 user nova-compute[86931]:     </system>
Nov 16 19:32:06 user nova-compute[86931]:   </sysinfo>
Nov 16 19:32:06 user nova-compute[86931]:   <os>
Nov 16 19:32:06 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:32:06 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:32:06 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:32:06 user nova-compute[86931]:   </os>
Nov 16 19:32:06 user nova-compute[86931]:   <features>
Nov 16 19:32:06 user nova-compute[86931]:     <acpi/>
Nov 16 19:32:06 user nova-compute[86931]:     <apic/>
Nov 16 19:32:06 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:32:06 user nova-compute[86931]:   </features>
Nov 16 19:32:06 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:32:06 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:32:06 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:32:06 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:32:06 user nova-compute[86931]:   </clock>
Nov 16 19:32:06 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:32:06 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:32:06 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:32:06 user nova-compute[86931]:   </cpu>
Nov 16 19:32:06 user nova-compute[86931]:   <devices>
Nov 16 19:32:06 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:32:06 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:32:06 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk"/>
Nov 16 19:32:06 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:32:06 user nova-compute[86931]:     </disk>
Nov 16 19:32:06 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:32:06 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:32:06 user nova-compute[86931]:       <source dev="/dev/sde"/>
Nov 16 19:32:06 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:32:06 user nova-compute[86931]:       <serial>3bde119e-a77d-4827-ad77-02b4dbb12877</serial>
Nov 16 19:32:06 user nova-compute[86931]:     </disk>
Nov 16 19:32:06 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:32:06 user nova-compute[86931]:       <mac address="fa:16:3e:74:67:94"/>
Nov 16 19:32:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:32:06 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:32:06 user nova-compute[86931]:       <target dev="tapec0dd494-b4"/>
Nov 16 19:32:06 user nova-compute[86931]:     </interface>
Nov 16 19:32:06 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:32:06 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/console.log" append="off"/>
Nov 16 19:32:06 user nova-compute[86931]:     </serial>
Nov 16 19:32:06 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:32:06 user nova-compute[86931]:     <video>
Nov 16 19:32:06 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:32:06 user nova-compute[86931]:     </video>
Nov 16 19:32:06 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:32:06 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:32:06 user nova-compute[86931]:     </rng>
Nov 16 19:32:06 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:32:06 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:32:06 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:32:06 user nova-compute[86931]:     </memballoon>
Nov 16 19:32:06 user nova-compute[86931]:   </devices>
Nov 16 19:32:06 user nova-compute[86931]: </domain>
Nov 16 19:32:06 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:31:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG os_vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbac5be8-4db8-50ce-81d9-37d9ea182943', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec0dd494-b4, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec0dd494-b4, col_values=(('qos', UUID('10d3adbd-8a25-46f5-90d2-0e9bfa9de9f0')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec0dd494-b4, col_values=(('external_ids', {'iface-id': 'ec0dd494-b4da-48ce-bfff-a77b0e3d2e69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:67:94', 'vm-uuid': '4dfb53cd-4239-4cea-80d5-ecd6ac8ed200'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:06 user nova-compute[86931]: INFO os_vif [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:32:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:07 user nova-compute[86931]: WARNING nova.compute.manager [req-64d4ee05-4022-486f-bf70-2ffd658f8c86 req-615b8c17-0339-4a32-b93e-bdd43088f2d6 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state resized and task_state resize_reverting.
Nov 16 19:32:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:32:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance running successfully.
Nov 16 19:32:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] finish_revert_migration finished successfully. {{(pid=86931) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:09 user nova-compute[86931]: WARNING nova.compute.manager [req-da6d4c7b-ffb3-4f50-85c8-c1beb2f53c35 req-ba021635-b358-4210-b8d9-1e130c39fa23 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state resized and task_state resize_reverting.
Nov 16 19:32:09 user nova-compute[86931]: INFO nova.compute.manager [None req-e97ceb8e-1179-4782-bc1e-3571946dbd22 tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance to original state: 'active'
Nov 16 19:32:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:32:12 user nova-compute[86931]: INFO nova.compute.manager [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] instance snapshotting
Nov 16 19:32:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Beginning live snapshot process
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820.delta 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820.delta 1073741824" returned: 0 in 0.051s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 19:32:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:32:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] COPY block job progress, current cursor: 18415616 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:32:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:32:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 19:32:14 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:32:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820.delta /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820.delta /opt/stack/data/nova/instances/snapshots/tmp86q3j708/61be08209ff04a86a072566415d9a820" returned: 0 in 0.595s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Snapshot extracted, beginning image upload
Nov 16 19:32:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Snapshot image upload complete
Nov 16 19:32:18 user nova-compute[86931]: INFO nova.compute.manager [None req-d9f25307-9ddd-4029-8075-6d9ffe412b90 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Took 6.07 seconds to snapshot the instance on the hypervisor.
Nov 16 19:32:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:21 user nova-compute[86931]: INFO nova.compute.manager [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Detaching volume 791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:32:21 user nova-compute[86931]: INFO nova.virt.block_device [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Attempting to driver detach volume 791c1da6-8867-4663-bf64-b651af99c02b from mountpoint /dev/vdb
Nov 16 19:32:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Attempting to detach device vdb from instance 3b54f114-2b97-4b0b-9149-06347861d653 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:32:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:32:21 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:32:21 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:32:21 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:32:21 user nova-compute[86931]:   <serial>791c1da6-8867-4663-bf64-b651af99c02b</serial>
Nov 16 19:32:21 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:32:21 user nova-compute[86931]: </disk>
Nov 16 19:32:21 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:32:21 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Successfully detached device vdb from instance 3b54f114-2b97-4b0b-9149-06347861d653 from the persistent domain config.
Nov 16 19:32:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b54f114-2b97-4b0b-9149-06347861d653 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:32:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:32:21 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:32:21 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:32:21 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:32:21 user nova-compute[86931]:   <serial>791c1da6-8867-4663-bf64-b651af99c02b</serial>
Nov 16 19:32:21 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:32:21 user nova-compute[86931]: </disk>
Nov 16 19:32:21 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:32:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:32:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:32:28 user nova-compute[86931]: INFO nova.compute.claims [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Claim successful on node user
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:32:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:32:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Creating image(s)
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "/opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "/opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.policy [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '608adfbbb5d74367a409c645ee871f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cfa544a56b847afbf03a50f1e7603f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk 1073741824" returned: 0 in 0.048s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:32:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Cannot resize image /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Ensure instance console log exists: /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Successfully created port: 9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Successfully updated port: 9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquired lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-changed-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Refreshing instance network info cache due to event network-changed-9f25a379-3b1a-4944-acba-51c2045aeefa. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:32:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] Acquiring lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating instance_info_cache with network_info: [{"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Releasing lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Instance network_info: |[{"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] Acquired lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Refreshing network info cache for port 9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Start _get_guest_xml network_info=[{"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:32:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893478513',display_name='tempest-AttachVolumeTestJSON-server-1893478513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893478513',id=25,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJr2OH0l7k9txCZTt294ybm+y+l6IJ2DVnpmqOY1QIYdHH07BYWAeKRIcezZhX+1AIjyRpwjy0IDqAc9PtCa/WBnkBlarwUQQeXwzjk4SVDtqpMx3tM8bMZtAyhSHt1yA==',key_name='tempest-keypair-1074649478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-tgn2gr06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=31c09889-4a92-40bb-a037-b7c4a0e0ce2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:32:31 user nova-compute[86931]:   <uuid>31c09889-4a92-40bb-a037-b7c4a0e0ce2b</uuid>
Nov 16 19:32:31 user nova-compute[86931]:   <name>instance-00000019</name>
Nov 16 19:32:31 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:32:31 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:32:31 user nova-compute[86931]:   <metadata>
Nov 16 19:32:31 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:32:31 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeTestJSON-server-1893478513</nova:name>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:32:31</nova:creationTime>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:32:31 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:32:31 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:owner>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:user uuid="608adfbbb5d74367a409c645ee871f6c">tempest-AttachVolumeTestJSON-1412638370-project-member</nova:user>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:project uuid="3cfa544a56b847afbf03a50f1e7603f2">tempest-AttachVolumeTestJSON-1412638370</nova:project>
Nov 16 19:32:31 user nova-compute[86931]:       </nova:owner>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:32:31 user nova-compute[86931]:       <nova:ports>
Nov 16 19:32:31 user nova-compute[86931]:         <nova:port uuid="9f25a379-3b1a-4944-acba-51c2045aeefa">
Nov 16 19:32:31 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:32:31 user nova-compute[86931]:         </nova:port>
Nov 16 19:32:31 user nova-compute[86931]:       </nova:ports>
Nov 16 19:32:31 user nova-compute[86931]:     </nova:instance>
Nov 16 19:32:31 user nova-compute[86931]:   </metadata>
Nov 16 19:32:31 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:32:31 user nova-compute[86931]:     <system>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="serial">31c09889-4a92-40bb-a037-b7c4a0e0ce2b</entry>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="uuid">31c09889-4a92-40bb-a037-b7c4a0e0ce2b</entry>
Nov 16 19:32:31 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:32:31 user nova-compute[86931]:     </system>
Nov 16 19:32:31 user nova-compute[86931]:   </sysinfo>
Nov 16 19:32:31 user nova-compute[86931]:   <os>
Nov 16 19:32:31 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:32:31 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:32:31 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:32:31 user nova-compute[86931]:   </os>
Nov 16 19:32:31 user nova-compute[86931]:   <features>
Nov 16 19:32:31 user nova-compute[86931]:     <acpi/>
Nov 16 19:32:31 user nova-compute[86931]:     <apic/>
Nov 16 19:32:31 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:32:31 user nova-compute[86931]:   </features>
Nov 16 19:32:31 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:32:31 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:32:31 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:32:31 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:32:31 user nova-compute[86931]:   </clock>
Nov 16 19:32:31 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:32:31 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:32:31 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:32:31 user nova-compute[86931]:   </cpu>
Nov 16 19:32:31 user nova-compute[86931]:   <devices>
Nov 16 19:32:31 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:32:31 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:32:31 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk"/>
Nov 16 19:32:31 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:32:31 user nova-compute[86931]:     </disk>
Nov 16 19:32:31 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:32:31 user nova-compute[86931]:       <mac address="fa:16:3e:6d:7e:02"/>
Nov 16 19:32:31 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:32:31 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:32:31 user nova-compute[86931]:       <target dev="tap9f25a379-3b"/>
Nov 16 19:32:31 user nova-compute[86931]:     </interface>
Nov 16 19:32:31 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:32:31 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/console.log" append="off"/>
Nov 16 19:32:31 user nova-compute[86931]:     </serial>
Nov 16 19:32:31 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:32:31 user nova-compute[86931]:     <video>
Nov 16 19:32:31 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:32:31 user nova-compute[86931]:     </video>
Nov 16 19:32:31 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:32:31 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:32:31 user nova-compute[86931]:     </rng>
Nov 16 19:32:31 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:32:31 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:32:31 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:32:31 user nova-compute[86931]:     </memballoon>
Nov 16 19:32:31 user nova-compute[86931]:   </devices>
Nov 16 19:32:31 user nova-compute[86931]: </domain>
Nov 16 19:32:31 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893478513',display_name='tempest-AttachVolumeTestJSON-server-1893478513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893478513',id=25,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJr2OH0l7k9txCZTt294ybm+y+l6IJ2DVnpmqOY1QIYdHH07BYWAeKRIcezZhX+1AIjyRpwjy0IDqAc9PtCa/WBnkBlarwUQQeXwzjk4SVDtqpMx3tM8bMZtAyhSHt1yA==',key_name='tempest-keypair-1074649478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-tgn2gr06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=31c09889-4a92-40bb-a037-b7c4a0e0ce2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG os_vif [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76a8e821-2bc3-59d4-9464-69944e1f9ba7', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f25a379-3b, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f25a379-3b, col_values=(('qos', UUID('7a12a12c-2e97-4bc5-9106-58d3fe10f11e')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f25a379-3b, col_values=(('external_ids', {'iface-id': '9f25a379-3b1a-4944-acba-51c2045aeefa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:7e:02', 'vm-uuid': '31c09889-4a92-40bb-a037-b7c4a0e0ce2b'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:31 user nova-compute[86931]: INFO os_vif [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b')
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No VIF found with MAC fa:16:3e:6d:7e:02, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updated VIF entry in instance network info cache for port 9f25a379-3b1a-4944-acba-51c2045aeefa. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating instance_info_cache with network_info: [{"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fe5eaaab-345b-434c-a9c7-904d760e927f req-5b2000e0-6a30-44e9-8285-3f10586e6b25 service nova] Releasing lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:32:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] No waiting events found dispatching network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:33 user nova-compute[86931]: WARNING nova.compute.manager [req-d2d43069-63cd-48b1-942b-bb6a55536080 req-e427b59c-f38f-4c1a-bc40-e27d38660d07 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received unexpected event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa for instance with vm_state building and task_state spawning.
Nov 16 19:32:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:32:34 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Instance spawned successfully.
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:32:34 user nova-compute[86931]: INFO nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 16 19:32:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:32:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] No waiting events found dispatching network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:35 user nova-compute[86931]: WARNING nova.compute.manager [req-5b43a7a1-7a94-455b-9afe-3abfbb09e99d req-2a9b24b0-4c52-4490-bc71-e73e104337b9 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received unexpected event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa for instance with vm_state active and task_state None.
Nov 16 19:32:35 user nova-compute[86931]: INFO nova.compute.manager [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Took 6.42 seconds to build instance.
Nov 16 19:32:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1d42d8c-c7ef-4421-a5e3-81a3e6ae89af tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.526s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-changed-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Refreshing instance network info cache due to event network-changed-85affde0-a55e-48c9-a756-a6ffae26ced3. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] Acquiring lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] Acquired lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Refreshing network info cache for port 85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updated VIF entry in instance network info cache for port 85affde0-a55e-48c9-a756-a6ffae26ced3. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updating instance_info_cache with network_info: [{"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a434940a-97cc-4a12-b511-bf0af12843fd req-801ad90b-b65e-4850-983e-f8b5b22fc237 service nova] Releasing lock "refresh_cache-173a94e7-b610-490f-80b4-432cad8f5c9b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:36 user nova-compute[86931]: INFO nova.compute.manager [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Terminating instance
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-unplugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] No waiting events found dispatching network-vif-unplugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-2fa13beb-ab2a-40d2-82b2-dc7b6ae72ba4 req-1cc0b9d1-fdd8-4a33-81a6-a73e8565556a service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-unplugged-85affde0-a55e-48c9-a756-a6ffae26ced3 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:32:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Instance destroyed successfully.
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid 173a94e7-b610-490f-80b4-432cad8f5c9b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2109974625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2109974625',id=23,image_ref='c71d10d0-c5b2-47a6-b2ea-52658d2172db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkKh+jqx5q5c2/lw7tGr6exf258eG6qKYW3MIV8CL32tVgCkaffiuFqHCzyFsO6VjvmI7jqVkRavOqRUmPeEQRk+2AOlT6YeKODA1gscE26ltK5bJiQE3DcnoWBt/w29g==',key_name='tempest-keypair-552034726',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-uzr1m2i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1009954453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=173a94e7-b610-490f-80b4-432cad8f5c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "85affde0-a55e-48c9-a756-a6ffae26ced3", "address": "fa:16:3e:5b:7c:f2", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85affde0-a5", "ovs_interfaceid": "85affde0-a55e-48c9-a756-a6ffae26ced3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_vif [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85affde0-a5, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43728316-151f-4a3b-b81a-302311066fe3) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:32:37 user nova-compute[86931]: INFO os_vif [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=85affde0-a55e-48c9-a756-a6ffae26ced3,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85affde0-a5')
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eInwobTc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:32:37 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd87d75-6316-40f3-bd52-3369a13bc4a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:32:37 user nova-compute[86931]: No targets found.
Nov 16 19:32:37 user nova-compute[86931]: iSNS:
Nov 16 19:32:37 user nova-compute[86931]: No targets found.
Nov 16 19:32:37 user nova-compute[86931]: STATIC:
Nov 16 19:32:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:32:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:32:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:32:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26
Nov 16 19:32:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:37 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:32:37 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:37 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:37 user nova-compute[86931]: FIRMWARE:
Nov 16 19:32:37 user nova-compute[86931]: No targets found.
Nov 16 19:32:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:32:37 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:32:37 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8e0c4b-d09e-4046-9a48-95075340fa30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c9d13b-7d34-4cd2-b0b3-8ca51794b8a1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14098cd-3d1b-444d-b416-8b031901488b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc1359-ceeb-4cab-b8c1-f49382e686f9]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1688c392-e3ad-4411-ac3c-8060c7aebe24]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aaefa9-9c2a-4b81-a1b9-f8246954e95a]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea9867d-0cf9-4f2f-bbe1-3996a214f58d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb410239-a704-4041-bb04-782f8fc809ea]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260]
Nov 16 19:32:37 user nova-compute[86931]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26, portal: 172.16.0.220,3260] successful.
Nov 16 19:32:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973d2283-5651-440d-87eb-7fbf74dc7d26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac57f7-da68-46bc-ab30-04c832971f55]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (335ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:32:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Deleting instance files /opt/stack/data/nova/instances/173a94e7-b610-490f-80b4-432cad8f5c9b_del
Nov 16 19:32:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Deletion of /opt/stack/data/nova/instances/173a94e7-b610-490f-80b4-432cad8f5c9b_del complete
Nov 16 19:32:37 user nova-compute[86931]: INFO nova.compute.manager [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 19:32:37 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:32:37 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:32:38 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:32:38 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Took 0.64 seconds to deallocate network for instance.
Nov 16 19:32:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-f0cbd82b-00e4-4f4c-b1e9-225ae9bce7ab req-d26c1e71-2bc4-4a10-b247-a1433dc82ccf service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-deleted-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] Acquiring lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] No waiting events found dispatching network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:32:39 user nova-compute[86931]: WARNING nova.compute.manager [req-89f665ea-7c8a-4281-83e1-42a430abfe34 req-eeec6ba0-6cfc-41b4-b6e3-30ea21e2aab8 service nova] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Received unexpected event network-vif-plugged-85affde0-a55e-48c9-a756-a6ffae26ced3 for instance with vm_state active and task_state deleting.
Nov 16 19:32:39 user nova-compute[86931]: INFO nova.compute.manager [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Took 0.94 seconds to detach 1 volumes for instance.
Nov 16 19:32:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 173a94e7-b610-490f-80b4-432cad8f5c9b] Deleting volume: 973d2283-5651-440d-87eb-7fbf74dc7d26 {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:32:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:39 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance 173a94e7-b610-490f-80b4-432cad8f5c9b
Nov 16 19:32:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a3a48543-b192-4104-a2e5-1734e0cb61de tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "173a94e7-b610-490f-80b4-432cad8f5c9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.453s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:40 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b54f114-2b97-4b0b-9149-06347861d653 is timed out.
Nov 16 19:32:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Successfully detached device vdb from instance 3b54f114-2b97-4b0b-9149-06347861d653 from the live domain config.
Nov 16 19:32:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZinUcDC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:32:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad79f22-e103-4824-8d6a-cd18f10b9e2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:32:42 user nova-compute[86931]: No targets found.
Nov 16 19:32:42 user nova-compute[86931]: iSNS:
Nov 16 19:32:42 user nova-compute[86931]: No targets found.
Nov 16 19:32:42 user nova-compute[86931]: STATIC:
Nov 16 19:32:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:32:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b
Nov 16 19:32:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:32:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:32:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:32:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:32:42 user nova-compute[86931]: FIRMWARE:
Nov 16 19:32:42 user nova-compute[86931]: No targets found.
Nov 16 19:32:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:32:42 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:32:42 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5163ca9a-88a5-4755-ac16-821b048a9967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a75dfd1-a9fe-424a-b05a-0971d9ec2c41]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b (non-flash)
Nov 16 19:32:42 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:32:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa6661cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5fdf7-ed41-4a8e-8999-3ade5ed8bde5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c3cf20-6567-4985-bd90-34c9bf7ffb3d]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a382ef55-8dce-44e9-afa1-679feae7fbd4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e87b79-378d-4334-b4ca-c6f0d4339a97]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bdae31-3475-459f-9e97-ca4af812c178]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[301e103c-cb67-4264-ac66-489b0334b39b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260]
Nov 16 19:32:42 user nova-compute[86931]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b, portal: 172.16.0.220,3260] successful.
Nov 16 19:32:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:791c1da6-8867-4663-bf64-b651af99c02b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb66ca-8d9f-4d2d-9a5c-30a3a2619567]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] <== disconnect_volume: return (320ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:32:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'flavor' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8614aafb-0e4b-4e07-a1c8-9af1a250e0eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:32:43 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updating instance_info_cache with network_info: [{"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-9a367ef3-2818-4c3a-b891-5d222491cdde" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:32:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:32:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:32:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.145610809326172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3b54f114-2b97-4b0b-9149-06347861d653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 1e19b001-5671-4298-a979-9fe267b9efcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:32:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:32:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:32:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:32:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:32:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:32:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:33:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:33:11 user nova-compute[86931]: INFO nova.compute.claims [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Claim successful on node user
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:33:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.policy [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c74086febf834740bbe6d094ebad864b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823d93d9aed54ef0aac913d3707f207f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:33:12 user nova-compute[86931]: INFO nova.virt.block_device [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Booting with volume 7b776c46-7cd7-4ceb-ba82-46f23fdd9989 at /dev/vda
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.utils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dde5cc1-27bd-4b9f-8b27-130d12a4a1e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cacf75-86da-4063-95d0-68f3ed7e47a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[046d9b2c-3617-4af1-8603-38b4128bb475]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50be49-c6ad-4605-9038-ffe8aba9aeb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:12 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cadbc6-1ba7-45e6-86f5-67bff41c6b03]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG os_brick.utils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating existing volume attachment record: 928e4069-1142-4d63-87f8-0598f12213c9 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:12 user nova-compute[86931]: INFO nova.compute.manager [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Terminating instance
Nov 16 19:33:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-93f54ddb-6d76-44de-b74f-51800651b55e req-e0c85907-0786-4fb3-87f2-361579853fd8 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-unplugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Successfully created port: 5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Instance destroyed successfully.
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lazy-loading 'resources' on Instance uuid 3b54f114-2b97-4b0b-9149-06347861d653 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1431386963',display_name='tempest-ServerStableDeviceRescueTest-server-1431386963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1431386963',id=17,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeSzYEh+wZ7nuNSMVhh98XEp5OjAKuoAbCz50lqaWXPtCcQ31Da5YhvKJ+JECZY9P2FQMJJ50l9qalXeXUoVIuB52v8dY17SPFqLUZVA2CdWuK5qoV12xVPg7SGgHoVyA==',key_name='tempest-keypair-1478691447',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:30:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1528a5e3fa244d98aa3ac2231fd3173',ramdisk_id='',reservation_id='r-mu4t02uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1093973425',owner_user_name='tempest-ServerStableDeviceRescueTest-1093973425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:31:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e43f609e3244c25bc951e870d50e639',uuid=3b54f114-2b97-4b0b-9149-06347861d653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converting VIF {"id": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "address": "fa:16:3e:96:33:4c", "network": {"id": "cf68569c-4d6d-4e4f-aa4c-7105086e5de2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181127571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1528a5e3fa244d98aa3ac2231fd3173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8997ab3d-23", "ovs_interfaceid": "8997ab3d-23ec-4b9b-8743-8269f35eb4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG os_vif [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8997ab3d-23, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b922f948-6ee8-44cb-9640-60104d1ad60c) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:13 user nova-compute[86931]: INFO os_vif [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:33:4c,bridge_name='br-int',has_traffic_filtering=True,id=8997ab3d-23ec-4b9b-8743-8269f35eb4a0,network=Network(cf68569c-4d6d-4e4f-aa4c-7105086e5de2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8997ab3d-23')
Nov 16 19:33:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Deleting instance files /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653_del
Nov 16 19:33:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Deletion of /opt/stack/data/nova/instances/3b54f114-2b97-4b0b-9149-06347861d653_del complete
Nov 16 19:33:13 user nova-compute[86931]: INFO nova.compute.manager [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:33:13 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:33:13 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Successfully updated port: 5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-changed-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Refreshing instance network info cache due to event network-changed-5418fbbb-8075-4eca-85f9-5a551f788b8c. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance network_info: |[{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Refreshing network info cache for port 5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:14 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Took 0.96 seconds to deallocate network for instance.
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:33:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:15 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Deleted allocations for instance 3b54f114-2b97-4b0b-9149-06347861d653
Nov 16 19:33:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a810a1e4-9fc2-4e6a-b610-c6ee68b9c5eb tempest-ServerStableDeviceRescueTest-1093973425 tempest-ServerStableDeviceRescueTest-1093973425-project-member] Lock "3b54f114-2b97-4b0b-9149-06347861d653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] Acquiring lock "3b54f114-2b97-4b0b-9149-06347861d653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] Lock "3b54f114-2b97-4b0b-9149-06347861d653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] No waiting events found dispatching network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:15 user nova-compute[86931]: WARNING nova.compute.manager [req-0b7ac0d4-701d-43f6-bb3a-c57fe3b4ef7e req-166b1a93-814f-415b-90cd-4eaaef9095d3 service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received unexpected event network-vif-plugged-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 for instance with vm_state deleted and task_state None.
Nov 16 19:33:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updated VIF entry in instance network info cache for port 5418fbbb-8075-4eca-85f9-5a551f788b8c. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97e7e54b-cc1c-4b0a-84f5-fb590bbb8430 req-c90b9de2-f5b6-4add-ac8f-75c4326fab94 service nova] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-49af98ad-e5a1-4977-80aa-8f32fa44670c req-78ec107d-7486-43f3-bda3-0ea1c07ba5bf service nova] [instance: 3b54f114-2b97-4b0b-9149-06347861d653] Received event network-vif-deleted-8997ab3d-23ec-4b9b-8743-8269f35eb4a0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:33:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Creating image(s)
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Ensure instance console log exists: /opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start _get_guest_xml network_info=[{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '928e4069-1142-4d63-87f8-0598f12213c9', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '105dd9f1-9f20-4f05-8dd4-ad360886dc09', 'attached_at': '', 'detached_at': '', 'volume_id': '7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'serial': '7b776c46-7cd7-4ceb-ba82-46f23fdd9989'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:33:18 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:18 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:18 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:18 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:18 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb279ff-2636-422e-aa7d-50120b00f08a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:33:18 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[35257355-68ff-4996-be34-ab51dd4e9453]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989] added
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[061e08b6-32f8-4495-bc79-2f3d711c5d3e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1558a11-083b-46a6-a45d-0f012a1f1330]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utyxqFhI {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utyxqFhI" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfe124-d8d1-41c9-ac70-af1a04629cdc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utyxqFhI'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d0ae0-8774-4716-b908-0634a8001adc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bcf3fe-7221-4d05-a7a3-4d902da944ff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b734ee8-ac35-4c57-ab3e-f15809ed6d5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]
Nov 16 19:33:18 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cbf8cd-96a4-4049-a10c-0459561ce536]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb8f685-2150-4af7-8811-5cdf842a594e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5d27ed-3a95-4a05-91a2-ca0b4024ba6e]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:33:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23535656266353465', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535656266353465', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.objects.instance [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'pci_devices' on Instance uuid 105dd9f1-9f20-4f05-8dd4-ad360886dc09 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:33:19 user nova-compute[86931]:   <uuid>105dd9f1-9f20-4f05-8dd4-ad360886dc09</uuid>
Nov 16 19:33:19 user nova-compute[86931]:   <name>instance-0000001a</name>
Nov 16 19:33:19 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:33:19 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:33:19 user nova-compute[86931]:   <metadata>
Nov 16 19:33:19 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:33:19 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:33:19 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherA-server-105731436</nova:name>
Nov 16 19:33:19 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:33:18</nova:creationTime>
Nov 16 19:33:19 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:33:19 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:33:19 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:33:19 user nova-compute[86931]:       <nova:owner>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:user uuid="c74086febf834740bbe6d094ebad864b">tempest-ServerActionsTestOtherA-672558396-project-member</nova:user>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:project uuid="823d93d9aed54ef0aac913d3707f207f">tempest-ServerActionsTestOtherA-672558396</nova:project>
Nov 16 19:33:19 user nova-compute[86931]:       </nova:owner>
Nov 16 19:33:19 user nova-compute[86931]:       <nova:ports>
Nov 16 19:33:19 user nova-compute[86931]:         <nova:port uuid="5418fbbb-8075-4eca-85f9-5a551f788b8c">
Nov 16 19:33:19 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 19:33:19 user nova-compute[86931]:         </nova:port>
Nov 16 19:33:19 user nova-compute[86931]:       </nova:ports>
Nov 16 19:33:19 user nova-compute[86931]:     </nova:instance>
Nov 16 19:33:19 user nova-compute[86931]:   </metadata>
Nov 16 19:33:19 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:33:19 user nova-compute[86931]:     <system>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="serial">105dd9f1-9f20-4f05-8dd4-ad360886dc09</entry>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="uuid">105dd9f1-9f20-4f05-8dd4-ad360886dc09</entry>
Nov 16 19:33:19 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:33:19 user nova-compute[86931]:     </system>
Nov 16 19:33:19 user nova-compute[86931]:   </sysinfo>
Nov 16 19:33:19 user nova-compute[86931]:   <os>
Nov 16 19:33:19 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:33:19 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:33:19 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:33:19 user nova-compute[86931]:   </os>
Nov 16 19:33:19 user nova-compute[86931]:   <features>
Nov 16 19:33:19 user nova-compute[86931]:     <acpi/>
Nov 16 19:33:19 user nova-compute[86931]:     <apic/>
Nov 16 19:33:19 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:33:19 user nova-compute[86931]:   </features>
Nov 16 19:33:19 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:33:19 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:33:19 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:33:19 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:33:19 user nova-compute[86931]:   </clock>
Nov 16 19:33:19 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:33:19 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:33:19 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:33:19 user nova-compute[86931]:   </cpu>
Nov 16 19:33:19 user nova-compute[86931]:   <devices>
Nov 16 19:33:19 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:33:19 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:33:19 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:33:19 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:33:19 user nova-compute[86931]:       <serial>7b776c46-7cd7-4ceb-ba82-46f23fdd9989</serial>
Nov 16 19:33:19 user nova-compute[86931]:     </disk>
Nov 16 19:33:19 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:33:19 user nova-compute[86931]:       <mac address="fa:16:3e:3d:3a:76"/>
Nov 16 19:33:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:33:19 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:33:19 user nova-compute[86931]:       <target dev="tap5418fbbb-80"/>
Nov 16 19:33:19 user nova-compute[86931]:     </interface>
Nov 16 19:33:19 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:33:19 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09/console.log" append="off"/>
Nov 16 19:33:19 user nova-compute[86931]:     </serial>
Nov 16 19:33:19 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:33:19 user nova-compute[86931]:     <video>
Nov 16 19:33:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:33:19 user nova-compute[86931]:     </video>
Nov 16 19:33:19 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:33:19 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:33:19 user nova-compute[86931]:     </rng>
Nov 16 19:33:19 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:33:19 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:33:19 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:33:19 user nova-compute[86931]:     </memballoon>
Nov 16 19:33:19 user nova-compute[86931]:   </devices>
Nov 16 19:33:19 user nova-compute[86931]: </domain>
Nov 16 19:33:19 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG os_vif [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f9f21a0-013d-5a7e-8680-9cc4ad6a8be4', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5418fbbb-80, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5418fbbb-80, col_values=(('qos', UUID('10631d27-edea-42ef-8fc0-39e8d9cda28b')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5418fbbb-80, col_values=(('external_ids', {'iface-id': '5418fbbb-8075-4eca-85f9-5a551f788b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:3a:76', 'vm-uuid': '105dd9f1-9f20-4f05-8dd4-ad360886dc09'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:19 user nova-compute[86931]: INFO os_vif [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80')
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:3d:3a:76, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:33:19 user nova-compute[86931]: INFO nova.compute.claims [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Claim successful on node user
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:33:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.policy [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c8c15e0597f411f81270cd3b181043b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97456514d9f541ec936e509c558e60db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:33:20 user nova-compute[86931]: INFO nova.virt.block_device [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Booting with volume-backed-image 04ef6bdb-1977-4f57-a0fb-6742ffba000b at /dev/vda
Nov 16 19:33:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Successfully created port: 538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:21 user nova-compute[86931]: WARNING nova.compute.manager [req-579483da-76d9-4368-866d-e0beb8b3ad42 req-4017a685-2151-495b-84f1-fd39273a4a52 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state building and task_state spawning.
Nov 16 19:33:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Successfully updated port: 538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-changed-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Refreshing instance network info cache due to event network-changed-538e3e11-ab42-42f7-97cf-0a3a56755514. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] Acquiring lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-changed-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Refreshing instance network info cache due to event network-changed-1fe5f2e1-f3a1-4ef0-8502-251147e0b400. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] Acquiring lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] Acquired lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Refreshing network info cache for port 1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance network_info: |[{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] Acquired lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Refreshing network info cache for port 538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updated VIF entry in instance network info cache for port 1fe5f2e1-f3a1-4ef0-8502-251147e0b400. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating instance_info_cache with network_info: [{"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updated VIF entry in instance network info cache for port 538e3e11-ab42-42f7-97cf-0a3a56755514. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-01c5365e-a6d5-4e5e-bf7e-ebe79345df5b req-27d43379-04de-4bc4-9b57-e74e40b8c580 service nova] Releasing lock "refresh_cache-a6231ab3-ae23-4b87-926c-86fd9e0a357b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-35100d5c-b297-427c-adf5-790e8964783a req-6bff66e4-13c7-49ca-8348-b2e344b05d32 service nova] Releasing lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:33:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance spawned successfully.
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:23 user nova-compute[86931]: INFO nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:33:23 user nova-compute[86931]: INFO nova.compute.manager [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Took 11.39 seconds to build instance.
Nov 16 19:33:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-72c64de6-3665-4679-92d2-b8c93368526b tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.495s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:23 user nova-compute[86931]: WARNING nova.compute.manager [req-f2ae1991-b6c7-41c8-9ae4-6b005683b194 req-18cb1b77-eea0-4ab3-a727-695570461eec service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state None.
Nov 16 19:33:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:25 user nova-compute[86931]: INFO nova.compute.manager [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attaching volume 0a3e03b8-4117-47d8-a6ef-646a28261475 to /dev/vdb
Nov 16 19:33:25 user nova-compute[86931]: DEBUG os_brick.utils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e9454-811c-4e18-a67c-1a8f29bd7c66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fdf81d-2a15-49a3-ad21-a6800ac0142a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154c55e-0e80-43de-a0fa-e1cebbd72b3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b1980c-72da-493b-b0fb-c5a29e5f14e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:33:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:26 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8590a1b-cb01-465f-a07d-92a8877bc821]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.utils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating existing volume attachment record: 71243e27-4ebd-446b-9468-c03107e7b424 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.utils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5e789-5f2f-4e19-94a0-9d92abe4bde6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1fb7ea-6699-4e76-a5c7-75fbcf1c3402]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e7052-8ea4-45d6-8845-e0214f830045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd58bd0-e607-4b82-a53b-8de82a06f68b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:33:26 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:33:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5867f0-443d-43d7-beee-f734b6b54396]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG os_brick.utils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating existing volume attachment record: bf13ea1c-7d5b-40c8-93cc-4c7278a47de3 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:33:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:29 user nova-compute[86931]: INFO nova.compute.manager [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Terminating instance
Nov 16 19:33:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-unplugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] No waiting events found dispatching network-vif-unplugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-4515b988-6b8c-45b7-8cfc-83673535dd14 req-e185c881-cd5b-4ca6-909a-f9d7efbf6e67 service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-unplugged-48e98eab-1914-45c5-8d77-e0ef29c397ad for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:33:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Instance destroyed successfully.
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid 1e19b001-5671-4298-a979-9fe267b9efcd {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:28:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1646981388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1646981388',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbi8RM8uJB9eC4o9U+Xeke40GtjCDSgdxIclaLxZt/WaHxBkoKHfThxUSEPQ/p3EinFvbylzj5bpGULkGw2cDrDT6fXCmg3JW3CkKdPbK5JPRxtnUVN6s2urJFuzaTn7g==',key_name='tempest-keypair-2030840794',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-g28l2ke0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:29:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=1e19b001-5671-4298-a979-9fe267b9efcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "address": "fa:16:3e:d5:b6:8c", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48e98eab-19", "ovs_interfaceid": "48e98eab-1914-45c5-8d77-e0ef29c397ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_vif [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48e98eab-19, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88fe10e7-135a-4b6e-b87e-a4493dce0078) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:33:30 user nova-compute[86931]: INFO os_vif [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b6:8c,bridge_name='br-int',has_traffic_filtering=True,id=48e98eab-1914-45c5-8d77-e0ef29c397ad,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48e98eab-19')
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCaRBycw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:30 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820eb98-82d8-4588-b001-aa14e7bc86e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:33:30 user nova-compute[86931]: No targets found.
Nov 16 19:33:30 user nova-compute[86931]: iSNS:
Nov 16 19:33:30 user nova-compute[86931]: No targets found.
Nov 16 19:33:30 user nova-compute[86931]: STATIC:
Nov 16 19:33:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:33:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:33:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:33:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:33:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:33:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:33:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:33:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:33:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:33:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd
Nov 16 19:33:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:33:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:33:30 user nova-compute[86931]: FIRMWARE:
Nov 16 19:33:30 user nova-compute[86931]: No targets found.
Nov 16 19:33:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:33:30 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:33:30 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[877884aa-1518-4c14-b557-b5ade60804f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe6d851-7faa-403e-94d7-66ed11d58952]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c7f5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c200561-2c1d-4f4e-a7c3-ca84aa4e181f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0df63-4db7-48dc-b670-78b2ace87958]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4567c-effe-4f17-b505-42fe0541ca02]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[22364a6f-aa21-4954-a1f8-aebc81cd35a7]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfa484ade-a4aa211ad5629992', '/dev/disk/by-id/scsi-26134616132313161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fa484ade') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3136d5-b280-4325-a981-6fca737cf628]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca030d05-4ef9-4eb9-b0d7-8d83f2310738]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbb2604-889b-4f41-b055-62c0bb3b101e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260]
Nov 16 19:33:30 user nova-compute[86931]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd, portal: 172.16.0.220,3260] successful.
Nov 16 19:33:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7174d66e-4819-479a-977e-ab2fb2dc7efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e944dbd-a2f0-40c4-a0a1-14e5720b9c88]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (347ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:33:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Deleting instance files /opt/stack/data/nova/instances/1e19b001-5671-4298-a979-9fe267b9efcd_del
Nov 16 19:33:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Deletion of /opt/stack/data/nova/instances/1e19b001-5671-4298-a979-9fe267b9efcd_del complete
Nov 16 19:33:30 user nova-compute[86931]: INFO nova.compute.manager [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 16 19:33:30 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:33:30 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:31 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Took 0.80 seconds to deallocate network for instance.
Nov 16 19:33:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] Acquiring lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] Lock "1e19b001-5671-4298-a979-9fe267b9efcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] No waiting events found dispatching network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:31 user nova-compute[86931]: WARNING nova.compute.manager [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received unexpected event network-vif-plugged-48e98eab-1914-45c5-8d77-e0ef29c397ad for instance with vm_state active and task_state deleting.
Nov 16 19:33:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-82e640a5-5d86-4ca1-9c8c-77e589b626c3 req-13878e6f-d594-4e8c-a3e5-e5e97afb4f5f service nova] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Received event network-vif-deleted-48e98eab-1914-45c5-8d77-e0ef29c397ad {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:32 user nova-compute[86931]: INFO nova.compute.manager [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Took 1.00 seconds to detach 1 volumes for instance.
Nov 16 19:33:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 1e19b001-5671-4298-a979-9fe267b9efcd] Deleting volume: 7174d66e-4819-479a-977e-ab2fb2dc7efd {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 19:33:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:32 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:33:32 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:33:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:33 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance 1e19b001-5671-4298-a979-9fe267b9efcd
Nov 16 19:33:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d18a335-4c7c-4be4-8297-84c7b684b4f9 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "1e19b001-5671-4298-a979-9fe267b9efcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.715s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVYkCMRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:37 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:37 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:37 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fd1f9-d199-4f72-8608-1a691fc34c54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:33:37 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1440081-dc12-46bf-a30d-188e2f9faa4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475] added
Nov 16 19:33:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90630f0c-3fd8-4bbb-a524-c2b56f16e688]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.098s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[828b7b87-1d2c-4135-9a0b-fa76e7c0e41d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVYkCMRF {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVYkCMRF" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b58a5f-95de-4401-8d0a-e71b00c95f5c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVYkCMRF'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f769082b-3163-4525-956c-f219d862009a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894b4fe-2dab-44fb-9bd6-a0f603c00a12]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648a50f-3cda-4d3a-a276-c64437aeba15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260]
Nov 16 19:33:37 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260] successful.
Nov 16 19:33:37 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:33:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:33:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Creating image(s)
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Ensure instance console log exists: /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start _get_guest_xml network_info=[{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'bf13ea1c-7d5b-40c8-93cc-4c7278a47de3', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f799e54-3a33-4e78-b043-dce4e012701f', 'attached_at': '', 'detached_at': '', 'volume_id': '9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'serial': '9161aa5a-0600-4b27-a9bf-04cf5708b67e'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:33:38 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:38 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e4cd4-cdcb-428e-950f-05d4ffcb06cf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:33:38 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066fbec-b377-4123-8c7d-de912c10c207]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5455b925-d9ec-4e80-bda4-5f60639516e4]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:33:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVYkCMRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23330633465303037', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330633465303037', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.039s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:33:39 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c0621-3543-46a4-b548-0be66e379713]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:33:39 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:33:39 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:33:39 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:33:39 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:33:39 user nova-compute[86931]:   <serial>0a3e03b8-4117-47d8-a6ef-646a28261475</serial>
Nov 16 19:33:39 user nova-compute[86931]: </disk>
Nov 16 19:33:39 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48241f0-e519-4135-ae38-f66907345c77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e] added
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78881d0-ec55-486f-87c8-b1bdd33a2c63]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f058c-c4b0-4844-a6e8-9da38a751518]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKCcSAjV {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKCcSAjV" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[792e7b97-ebac-4dc2-8f94-76b8e9f62dde]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YKCcSAjV'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[536e827c-f67f-42d9-a669-795866958be1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758ba15-ed62-40c2-a207-7fbf86a21949]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dfc247-df3d-4c7f-a811-32846acdd6ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260]
Nov 16 19:33:39 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260] successful.
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa2b78d-0a37-4a0b-9f7a-40aa9fd11203]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[39393809-42b6-4ed9-8cfc-5fa593b977ba]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:33:39 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:33:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcc9e5-fbf0-4eab-8495-8c081b5e72e9]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No VIF found with MAC fa:16:3e:63:da:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:33:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9641ba7a-19f6-47ee-8bf7-0e36b089083a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.860s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== connect_volume: return (2372ms) {'type': 'block', 'scsi_wwn': '23731393536653536', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731393536653536', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910491494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910491494',id=27,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-ykgsiy3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:33:20Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=3f799e54-3a33-4e78-b043-dce4e012701f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:33:40 user nova-compute[86931]:   <uuid>3f799e54-3a33-4e78-b043-dce4e012701f</uuid>
Nov 16 19:33:40 user nova-compute[86931]:   <name>instance-0000001b</name>
Nov 16 19:33:40 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:33:40 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:33:40 user nova-compute[86931]:   <metadata>
Nov 16 19:33:40 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:33:40 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1910491494</nova:name>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:33:38</nova:creationTime>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:33:40 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:33:40 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:owner>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:33:40 user nova-compute[86931]:       </nova:owner>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:33:40 user nova-compute[86931]:       <nova:ports>
Nov 16 19:33:40 user nova-compute[86931]:         <nova:port uuid="538e3e11-ab42-42f7-97cf-0a3a56755514">
Nov 16 19:33:40 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 19:33:40 user nova-compute[86931]:         </nova:port>
Nov 16 19:33:40 user nova-compute[86931]:       </nova:ports>
Nov 16 19:33:40 user nova-compute[86931]:     </nova:instance>
Nov 16 19:33:40 user nova-compute[86931]:   </metadata>
Nov 16 19:33:40 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:33:40 user nova-compute[86931]:     <system>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="serial">3f799e54-3a33-4e78-b043-dce4e012701f</entry>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="uuid">3f799e54-3a33-4e78-b043-dce4e012701f</entry>
Nov 16 19:33:40 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:33:40 user nova-compute[86931]:     </system>
Nov 16 19:33:40 user nova-compute[86931]:   </sysinfo>
Nov 16 19:33:40 user nova-compute[86931]:   <os>
Nov 16 19:33:40 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:33:40 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:33:40 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:33:40 user nova-compute[86931]:   </os>
Nov 16 19:33:40 user nova-compute[86931]:   <features>
Nov 16 19:33:40 user nova-compute[86931]:     <acpi/>
Nov 16 19:33:40 user nova-compute[86931]:     <apic/>
Nov 16 19:33:40 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:33:40 user nova-compute[86931]:   </features>
Nov 16 19:33:40 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:33:40 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:33:40 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:33:40 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:33:40 user nova-compute[86931]:   </clock>
Nov 16 19:33:40 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:33:40 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:33:40 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:33:40 user nova-compute[86931]:   </cpu>
Nov 16 19:33:40 user nova-compute[86931]:   <devices>
Nov 16 19:33:40 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:33:40 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:33:40 user nova-compute[86931]:       <source dev="/dev/sdf"/>
Nov 16 19:33:40 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:33:40 user nova-compute[86931]:       <serial>9161aa5a-0600-4b27-a9bf-04cf5708b67e</serial>
Nov 16 19:33:40 user nova-compute[86931]:     </disk>
Nov 16 19:33:40 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:33:40 user nova-compute[86931]:       <mac address="fa:16:3e:72:3e:5d"/>
Nov 16 19:33:40 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:33:40 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:33:40 user nova-compute[86931]:       <target dev="tap538e3e11-ab"/>
Nov 16 19:33:40 user nova-compute[86931]:     </interface>
Nov 16 19:33:40 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:33:40 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/console.log" append="off"/>
Nov 16 19:33:40 user nova-compute[86931]:     </serial>
Nov 16 19:33:40 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:33:40 user nova-compute[86931]:     <video>
Nov 16 19:33:40 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:33:40 user nova-compute[86931]:     </video>
Nov 16 19:33:40 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:33:40 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:33:40 user nova-compute[86931]:     </rng>
Nov 16 19:33:40 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:33:40 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:33:40 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:33:40 user nova-compute[86931]:     </memballoon>
Nov 16 19:33:40 user nova-compute[86931]:   </devices>
Nov 16 19:33:40 user nova-compute[86931]: </domain>
Nov 16 19:33:40 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910491494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910491494',id=27,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-ykgsiy3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:33:20Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=3f799e54-3a33-4e78-b043-dce4e012701f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG os_vif [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ad95c1-5c32-52b0-8c45-31db8faa45a4', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap538e3e11-ab, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap538e3e11-ab, col_values=(('qos', UUID('e477fb77-0c01-4cc2-929f-11a8c9cbcaae')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap538e3e11-ab, col_values=(('external_ids', {'iface-id': '538e3e11-ab42-42f7-97cf-0a3a56755514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:3e:5d', 'vm-uuid': '3f799e54-3a33-4e78-b043-dce4e012701f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:40 user nova-compute[86931]: INFO os_vif [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab')
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:33:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:72:3e:5d, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:41 user nova-compute[86931]: WARNING nova.compute.manager [req-3b50cb64-dcde-45ad-ab0f-88716049bc5f req-59939bc7-6742-42c1-b934-7d31ffe2f086 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state building and task_state spawning.
Nov 16 19:33:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:33:44 user nova-compute[86931]: WARNING nova.compute.manager [req-f8b9ed13-bcf6-4850-9633-32de05f59c02 req-86a5d778-d269-46f0-9ed8-523330da8e99 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state building and task_state spawning.
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:33:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance spawned successfully.
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:33:44 user nova-compute[86931]: INFO nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:33:44 user nova-compute[86931]: INFO nova.compute.manager [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Took 24.47 seconds to build instance.
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7371af51-8ccf-4148-8d86-866c4a68c74f tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.580s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:33:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [{"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:33:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:33:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:33:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7723MB free_disk=25.231189727783203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9a367ef3-2818-4c3a-b891-5d222491cdde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:33:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:33:50 user nova-compute[86931]: INFO nova.compute.manager [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Detaching volume 0a3e03b8-4117-47d8-a6ef-646a28261475
Nov 16 19:33:50 user nova-compute[86931]: INFO nova.virt.block_device [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attempting to driver detach volume 0a3e03b8-4117-47d8-a6ef-646a28261475 from mountpoint /dev/vdb
Nov 16 19:33:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Attempting to detach device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:33:50 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:33:50 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:33:50 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:33:50 user nova-compute[86931]:   <serial>0a3e03b8-4117-47d8-a6ef-646a28261475</serial>
Nov 16 19:33:50 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:33:50 user nova-compute[86931]: </disk>
Nov 16 19:33:50 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:33:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config.
Nov 16 19:33:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:33:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:33:50 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:33:50 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:33:50 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:33:50 user nova-compute[86931]:   <serial>0a3e03b8-4117-47d8-a6ef-646a28261475</serial>
Nov 16 19:33:50 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:33:50 user nova-compute[86931]: </disk>
Nov 16 19:33:50 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:33:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:33:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:33:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:11 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b is timed out.
Nov 16 19:34:11 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config.
Nov 16 19:34:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVYkCMRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:11 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[246fcc94-f02b-441d-a278-8dd48f8c41bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:34:11 user nova-compute[86931]: No targets found.
Nov 16 19:34:11 user nova-compute[86931]: iSNS:
Nov 16 19:34:11 user nova-compute[86931]: No targets found.
Nov 16 19:34:11 user nova-compute[86931]: STATIC:
Nov 16 19:34:11 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475
Nov 16 19:34:11 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:11 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:11 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:34:11 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:11 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:11 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:34:11 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:11 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:11 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:34:11 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:11 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:11 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:34:11 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:11 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:11 user nova-compute[86931]: FIRMWARE:
Nov 16 19:34:11 user nova-compute[86931]: No targets found.
Nov 16 19:34:11 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:34:11 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:34:11 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a060e52-18db-4598-8811-879d40bcd4ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d7298-9de8-4d39-97a3-67dde9bc361d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:11 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 (non-flash)
Nov 16 19:34:11 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:11 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c466830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e6be2f-2107-4bf9-987c-ecefdcd866e7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8f8d8-aa04-419c-8114-0e366c570011]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc894be-a7e1-4204-a17c-402e3f999cc3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[301a4c51-4281-4759-b7c2-41a601c62cde]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d874ef4-f2e4-4ad6-93f9-174c015f0902]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a1cf1-2e10-4f72-8c3f-3704940d0943]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260]
Nov 16 19:34:11 user nova-compute[86931]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:11 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a3e03b8-4117-47d8-a6ef-646a28261475 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04144fa-5eac-48de-8192-efdb18bf3ef7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== disconnect_volume: return (308ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:34:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:12 user nova-compute[86931]: DEBUG nova.objects.instance [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-233c265d-c5cb-4704-a294-dc37e33ef87a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:34:18 user nova-compute[86931]: INFO nova.compute.claims [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Claim successful on node user
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:34:19 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.policy [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a00a0387df984129850f1fb1e29a35ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6184534338e74f3d827b9aee3e20c617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-changed-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Refreshing instance network info cache due to event network-changed-9f25a379-3b1a-4944-acba-51c2045aeefa. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] Acquiring lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] Acquired lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Refreshing network info cache for port 9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:34:19 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Creating image(s)
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk 1073741824" returned: 0 in 0.062s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.network.neutron [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updated VIF entry in instance network info cache for port 9f25a379-3b1a-4944-acba-51c2045aeefa. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.network.neutron [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating instance_info_cache with network_info: [{"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d4bdf8f0-0c3d-462a-9b3d-e77804d45494 req-58075d8c-2f1c-4b18-97ba-46d7cf0c8ff2 service nova] Releasing lock "refresh_cache-31c09889-4a92-40bb-a037-b7c4a0e0ce2b" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Cannot resize image /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Successfully created port: b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Successfully updated port: b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:34:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing instance network info cache due to event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance network_info: |[{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start _get_guest_xml network_info=[{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:34:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN62Tm2hkJO31mI8sKVjFAW7p+2HWIdVslzjEy3GpvN6Tv7YWvSCXbf5V+LnWm5SBYycrbysIWt/FO8SusP23pjycJCubr71x/+WOIsrEgWT/LQ+W1Du4Z7Bwzy0lNl9aw==',key_name='tempest-keypair-2010505057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.objects.instance [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:34:21 user nova-compute[86931]:   <uuid>8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</uuid>
Nov 16 19:34:21 user nova-compute[86931]:   <name>instance-0000001c</name>
Nov 16 19:34:21 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:34:21 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:34:21 user nova-compute[86931]:   <metadata>
Nov 16 19:34:21 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:34:21 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-616727702</nova:name>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:34:21</nova:creationTime>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:34:21 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:34:21 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:owner>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:user uuid="a00a0387df984129850f1fb1e29a35ce">tempest-AttachVolumeShelveTestJSON-470403389-project-member</nova:user>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:project uuid="6184534338e74f3d827b9aee3e20c617">tempest-AttachVolumeShelveTestJSON-470403389</nova:project>
Nov 16 19:34:21 user nova-compute[86931]:       </nova:owner>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:34:21 user nova-compute[86931]:       <nova:ports>
Nov 16 19:34:21 user nova-compute[86931]:         <nova:port uuid="b06d9c28-33e4-492a-9e67-a69ec3b768e8">
Nov 16 19:34:21 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:34:21 user nova-compute[86931]:         </nova:port>
Nov 16 19:34:21 user nova-compute[86931]:       </nova:ports>
Nov 16 19:34:21 user nova-compute[86931]:     </nova:instance>
Nov 16 19:34:21 user nova-compute[86931]:   </metadata>
Nov 16 19:34:21 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:34:21 user nova-compute[86931]:     <system>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="serial">8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</entry>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="uuid">8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</entry>
Nov 16 19:34:21 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:34:21 user nova-compute[86931]:     </system>
Nov 16 19:34:21 user nova-compute[86931]:   </sysinfo>
Nov 16 19:34:21 user nova-compute[86931]:   <os>
Nov 16 19:34:21 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:34:21 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:34:21 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:34:21 user nova-compute[86931]:   </os>
Nov 16 19:34:21 user nova-compute[86931]:   <features>
Nov 16 19:34:21 user nova-compute[86931]:     <acpi/>
Nov 16 19:34:21 user nova-compute[86931]:     <apic/>
Nov 16 19:34:21 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:34:21 user nova-compute[86931]:   </features>
Nov 16 19:34:21 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:34:21 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:34:21 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:34:21 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:34:21 user nova-compute[86931]:   </clock>
Nov 16 19:34:21 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:34:21 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:34:21 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:34:21 user nova-compute[86931]:   </cpu>
Nov 16 19:34:21 user nova-compute[86931]:   <devices>
Nov 16 19:34:21 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:34:21 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:34:21 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk"/>
Nov 16 19:34:21 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:34:21 user nova-compute[86931]:     </disk>
Nov 16 19:34:21 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:34:21 user nova-compute[86931]:       <mac address="fa:16:3e:9b:c8:50"/>
Nov 16 19:34:21 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:34:21 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:34:21 user nova-compute[86931]:       <target dev="tapb06d9c28-33"/>
Nov 16 19:34:21 user nova-compute[86931]:     </interface>
Nov 16 19:34:21 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:34:21 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/console.log" append="off"/>
Nov 16 19:34:21 user nova-compute[86931]:     </serial>
Nov 16 19:34:21 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:34:21 user nova-compute[86931]:     <video>
Nov 16 19:34:21 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:34:21 user nova-compute[86931]:     </video>
Nov 16 19:34:21 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:34:21 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:34:21 user nova-compute[86931]:     </rng>
Nov 16 19:34:21 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:34:21 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:34:21 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:34:21 user nova-compute[86931]:     </memballoon>
Nov 16 19:34:21 user nova-compute[86931]:   </devices>
Nov 16 19:34:21 user nova-compute[86931]: </domain>
Nov 16 19:34:21 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN62Tm2hkJO31mI8sKVjFAW7p+2HWIdVslzjEy3GpvN6Tv7YWvSCXbf5V+LnWm5SBYycrbysIWt/FO8SusP23pjycJCubr71x/+WOIsrEgWT/LQ+W1Du4Z7Bwzy0lNl9aw==',key_name='tempest-keypair-2010505057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG os_vif [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '751aac3e-5608-53b4-b2b5-31c7d2aaec0c', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb06d9c28-33, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb06d9c28-33, col_values=(('qos', UUID('779954f3-d225-478a-98de-300a0f313ea2')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb06d9c28-33, col_values=(('external_ids', {'iface-id': 'b06d9c28-33e4-492a-9e67-a69ec3b768e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c8:50', 'vm-uuid': '8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: INFO os_vif [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33')
Nov 16 19:34:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No VIF found with MAC fa:16:3e:9b:c8:50, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updated VIF entry in instance network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3fc467cb-852b-4380-a109-38e5687a01d6 req-9bf6b985-eb2c-427e-903d-e1e07205eec3 service nova] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:22 user nova-compute[86931]: INFO nova.compute.manager [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attaching volume ab69a63d-2ce6-4723-abb5-1763abd7df3f to /dev/vdb
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.utils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ebd6c-7b73-4512-b5f4-fee1ce2895fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7864106-3bc1-4690-883b-948311fbd504]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c77665-a0ac-4d2e-b875-8a63e99577fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4974a-feff-4058-bc36-1d36efc3e606]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:22 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:34:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b205c-e21c-45d4-8dbe-166bf8f4b3e1]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG os_brick.utils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:22 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating existing volume attachment record: 436938e7-be14-4949-bdac-7c47e24ff077 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:23 user nova-compute[86931]: WARNING nova.compute.manager [req-424bf570-927d-4062-9428-bdd9f8ceff0f req-67539ab4-c13b-4dbb-a1e7-7f32408c2839 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state building and task_state spawning.
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:34:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance spawned successfully.
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:25 user nova-compute[86931]: INFO nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 16 19:34:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:34:25 user nova-compute[86931]: INFO nova.compute.manager [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Took 6.81 seconds to build instance.
Nov 16 19:34:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-912f86a8-c6ef-44e5-8f5b-1005ba209cff tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.919s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:26 user nova-compute[86931]: WARNING nova.compute.manager [req-e452e78f-7761-42d3-aa1a-75e1e886c5bc req-9b841331-3817-4e7b-ad36-9d20b2c7260d service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state active and task_state None.
Nov 16 19:34:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAKMrNft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:28 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:28 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:28 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fcd15e-e6ae-4630-a385-11a7766ba240]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:34:28 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df99e36-78fd-4be6-9000-d566321854b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f] added
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdf10d-7a2b-494e-aa82-45a88b63ebf3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9783c5-ec3b-4f59-badf-6d6553bff0bc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAKMrNft {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAKMrNft" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ceda3-2c46-4acc-86ef-6c83066c322e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iAKMrNft'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0d65e-953d-470c-811e-7201fdf9f109]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22d003-3ca0-4b2f-a449-0ec253ad35e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3b40d6-2026-43c0-8535-4254653b66da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260]
Nov 16 19:34:28 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82debf34-3bd5-4b20-8c6c-d79136a7937e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd99358-3cfa-4839-962d-16cfe8a2ab5e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:28 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bfba4a-4d22-4f59-ad59-78319bf2a2fd]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAKMrNft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:28 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:34:29 user nova-compute[86931]: INFO nova.compute.claims [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Claim successful on node user
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23465623434353332', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465623434353332', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:34:29 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:29 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:34:29 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:29 user nova-compute[86931]:   <serial>ab69a63d-2ce6-4723-abb5-1763abd7df3f</serial>
Nov 16 19:34:29 user nova-compute[86931]: </disk>
Nov 16 19:34:29 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:34:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.policy [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:34:29 user nova-compute[86931]: INFO nova.virt.block_device [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Booting with volume d7cb7c5a-08ec-46f1-8e73-ae067625a409 at /dev/vda
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.utils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2863a923-031b-4b48-bf7d-1ebefcff1426]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a41d54-d0ac-4c51-ab26-db03a51c97c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b2f8c3-9f1a-4ca1-974b-f3069f98aa92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd679db-fad1-4be5-9eb0-125fd92c1f73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:29 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:34:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[15114a46-11f0-4c36-ae1b-1d96a08cdd02]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG os_brick.utils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updating existing volume attachment record: c63590ac-78d5-494d-b7dd-42fa39e3ece5 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No VIF found with MAC fa:16:3e:6d:7e:02, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:34:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f2ef896e-2bb3-4b71-98c1-6e8b285522ff tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.635s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Successfully created port: 12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:34:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Successfully updated port: 12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-changed-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Refreshing instance network info cache due to event network-changed-12e878fc-a692-4228-976a-17109e124df5. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] Acquiring lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updating instance_info_cache with network_info: [{"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Instance network_info: |[{"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] Acquired lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Refreshing network info cache for port 12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updated VIF entry in instance network info cache for port 12e878fc-a692-4228-976a-17109e124df5. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updating instance_info_cache with network_info: [{"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-501bbab2-438b-48a2-a5e5-b28e14224938 req-17aa3d9c-6532-4c2a-b3ea-595e05a01afc service nova] Releasing lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG nova.objects.instance [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:33 user nova-compute[86931]: INFO nova.compute.manager [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attaching volume 1e714924-5f48-419e-9809-6791d102a81b to /dev/vdc
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.utils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb11836-1cca-4c34-b0d9-2dbe7d9dfe9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5039284-b1e7-4dec-b0ec-4a5a1c96faa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f9eee-b647-4b12-b5a1-1524a27510a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee459c6-b34c-473e-af93-b15b15d334bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:34 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:34:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[26056422-c2f6-4858-8abb-58a441469afb]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG os_brick.utils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:34 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating existing volume attachment record: 67214e5e-87de-4446-8b5a-f723770185aa {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:34:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Creating image(s)
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Ensure instance console log exists: /opt/stack/data/nova/instances/64be39ba-20af-46b5-94d7-bec4c08a4775/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Start _get_guest_xml network_info=[{"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c63590ac-78d5-494d-b7dd-42fa39e3ece5', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64be39ba-20af-46b5-94d7-bec4c08a4775', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7cb7c5a-08ec-46f1-8e73-ae067625a409', 'serial': 'd7cb7c5a-08ec-46f1-8e73-ae067625a409'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:34:35 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:35 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:35 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:35 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:35 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a766ba-4b0f-428c-95b6-29cbdc54c192]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:34:35 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab39a63-5089-4de5-82d4-534fcb957f4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409] added
Nov 16 19:34:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf149233-2130-4afd-8369-6e13534cdbd3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6ffdc-83d9-4e9e-be9c-1cdb2f976215]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IODwXREl {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IODwXREl" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ba397b-dbc2-493f-96e7-03a1acf1804c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IODwXREl'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055f8b6-5d13-4e8e-8dfa-74b08cd575f1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a3302-7b63-41c7-a909-8faf59c886ba]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2dbeeb-2c40-4f1f-89b4-b5a0f650cf1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]
Nov 16 19:34:35 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a80a90-f6d4-4053-8ce7-d1e6901b0130]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068fd36-c2fe-45fe-a49d-579b89a0d6ed]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:35 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:36 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:36 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:36 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:36 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:36 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:36 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6701cf-a565-46e9-80c7-7d7b027a4cf3]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26430383964303866', 'path': '/dev/sdg'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430383964303866', 'path': '/dev/sdg'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558632597',display_name='tempest-TestVolumeBootPattern-server-558632597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558632597',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-suylwqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:34:30Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=64be39ba-20af-46b5-94d7-bec4c08a4775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.objects.instance [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid 64be39ba-20af-46b5-94d7-bec4c08a4775 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:34:37 user nova-compute[86931]:   <uuid>64be39ba-20af-46b5-94d7-bec4c08a4775</uuid>
Nov 16 19:34:37 user nova-compute[86931]:   <name>instance-0000001d</name>
Nov 16 19:34:37 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:34:37 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:34:37 user nova-compute[86931]:   <metadata>
Nov 16 19:34:37 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:34:37 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:34:37 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-server-558632597</nova:name>
Nov 16 19:34:37 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:34:35</nova:creationTime>
Nov 16 19:34:37 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:34:37 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:34:37 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:34:37 user nova-compute[86931]:       <nova:owner>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:34:37 user nova-compute[86931]:       </nova:owner>
Nov 16 19:34:37 user nova-compute[86931]:       <nova:ports>
Nov 16 19:34:37 user nova-compute[86931]:         <nova:port uuid="12e878fc-a692-4228-976a-17109e124df5">
Nov 16 19:34:37 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:34:37 user nova-compute[86931]:         </nova:port>
Nov 16 19:34:37 user nova-compute[86931]:       </nova:ports>
Nov 16 19:34:37 user nova-compute[86931]:     </nova:instance>
Nov 16 19:34:37 user nova-compute[86931]:   </metadata>
Nov 16 19:34:37 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:34:37 user nova-compute[86931]:     <system>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="serial">64be39ba-20af-46b5-94d7-bec4c08a4775</entry>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="uuid">64be39ba-20af-46b5-94d7-bec4c08a4775</entry>
Nov 16 19:34:37 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:34:37 user nova-compute[86931]:     </system>
Nov 16 19:34:37 user nova-compute[86931]:   </sysinfo>
Nov 16 19:34:37 user nova-compute[86931]:   <os>
Nov 16 19:34:37 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:34:37 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:34:37 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:34:37 user nova-compute[86931]:   </os>
Nov 16 19:34:37 user nova-compute[86931]:   <features>
Nov 16 19:34:37 user nova-compute[86931]:     <acpi/>
Nov 16 19:34:37 user nova-compute[86931]:     <apic/>
Nov 16 19:34:37 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:34:37 user nova-compute[86931]:   </features>
Nov 16 19:34:37 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:34:37 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:34:37 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:34:37 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:34:37 user nova-compute[86931]:   </clock>
Nov 16 19:34:37 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:34:37 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:34:37 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:34:37 user nova-compute[86931]:   </cpu>
Nov 16 19:34:37 user nova-compute[86931]:   <devices>
Nov 16 19:34:37 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:34:37 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:37 user nova-compute[86931]:       <source dev="/dev/sdg"/>
Nov 16 19:34:37 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:34:37 user nova-compute[86931]:       <serial>d7cb7c5a-08ec-46f1-8e73-ae067625a409</serial>
Nov 16 19:34:37 user nova-compute[86931]:     </disk>
Nov 16 19:34:37 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:34:37 user nova-compute[86931]:       <mac address="fa:16:3e:b4:75:8a"/>
Nov 16 19:34:37 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:34:37 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:34:37 user nova-compute[86931]:       <target dev="tap12e878fc-a6"/>
Nov 16 19:34:37 user nova-compute[86931]:     </interface>
Nov 16 19:34:37 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:34:37 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/64be39ba-20af-46b5-94d7-bec4c08a4775/console.log" append="off"/>
Nov 16 19:34:37 user nova-compute[86931]:     </serial>
Nov 16 19:34:37 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:34:37 user nova-compute[86931]:     <video>
Nov 16 19:34:37 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:34:37 user nova-compute[86931]:     </video>
Nov 16 19:34:37 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:34:37 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:34:37 user nova-compute[86931]:     </rng>
Nov 16 19:34:37 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:34:37 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:34:37 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:34:37 user nova-compute[86931]:     </memballoon>
Nov 16 19:34:37 user nova-compute[86931]:   </devices>
Nov 16 19:34:37 user nova-compute[86931]: </domain>
Nov 16 19:34:37 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558632597',display_name='tempest-TestVolumeBootPattern-server-558632597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558632597',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-suylwqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:34:30Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=64be39ba-20af-46b5-94d7-bec4c08a4775,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG os_vif [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66ad52d5-3503-5162-9dac-ad4c587824ce', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12e878fc-a6, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12e878fc-a6, col_values=(('qos', UUID('a7f4222b-351b-4166-84dd-dd320d85a891')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12e878fc-a6, col_values=(('external_ids', {'iface-id': '12e878fc-a692-4228-976a-17109e124df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:75:8a', 'vm-uuid': '64be39ba-20af-46b5-94d7-bec4c08a4775'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:37 user nova-compute[86931]: INFO os_vif [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6')
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:b4:75:8a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] No waiting events found dispatching network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:38 user nova-compute[86931]: WARNING nova.compute.manager [req-b655281e-eca6-4d5c-b4f9-1b50386ebb22 req-30a28fb5-a755-4ed7-a1f4-d36b384c7e10 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received unexpected event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 for instance with vm_state building and task_state spawning.
Nov 16 19:34:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcCgZfmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:39 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d7bcd-0ec5-4c97-ae99-80c8d6760d21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:34:39 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b5aaa-3e57-4ba5-ab4e-3bf92391873d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b] added
Nov 16 19:34:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82c41d4-4fc2-4f2c-aa15-c5219f195edb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f4d2a-358e-4b83-89e2-9d7574ce9678]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcCgZfmx {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcCgZfmx" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d0845-fd9d-44a2-9dd2-0dd06b80ec79]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcCgZfmx'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3952a5ad-29e8-40dd-8e9b-d6524c145b76]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4992721-8f01-4d53-a372-503951162381]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc13620-7dc4-4d22-902b-9d28248048d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260]
Nov 16 19:34:40 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[57369f74-ec94-4fb7-aa48-1ee9a2ab3e49]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[227eb19a-4be7-4db2-969f-e63d6cd338e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:40 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433302c-36a5-404c-9f9c-31b7308be94c]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcCgZfmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] No waiting events found dispatching network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:40 user nova-compute[86931]: WARNING nova.compute.manager [req-89493396-ebd6-432c-887f-2eff397ec588 req-128109b5-36ad-4b2e-a5c3-3a71356d7526 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received unexpected event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 for instance with vm_state building and task_state spawning.
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:34:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Instance spawned successfully.
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:34:40 user nova-compute[86931]: INFO nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 16 19:34:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:34:40 user nova-compute[86931]: INFO nova.compute.manager [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Took 11.93 seconds to build instance.
Nov 16 19:34:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-29e5e62f-f9cb-44de-8ed0-5e533fb4019a tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.026s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:41 user nova-compute[86931]: INFO nova.compute.manager [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Terminating instance
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23838316230313337', 'path': '/dev/sdh'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838316230313337', 'path': '/dev/sdh'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:34:41 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:41 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:34:41 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:34:41 user nova-compute[86931]:   <serial>1e714924-5f48-419e-9809-6791d102a81b</serial>
Nov 16 19:34:41 user nova-compute[86931]: </disk>
Nov 16 19:34:41 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-unplugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] No waiting events found dispatching network-vif-unplugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-5022e704-d8ae-43bb-ac35-08da3e33ae80 req-bf0e07ab-5259-4160-9dd1-b19c32aa35a3 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-unplugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] No VIF found with MAC fa:16:3e:6d:7e:02, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-338e4099-74fa-4ccb-91d9-9c577e338fa1 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.285s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Instance destroyed successfully.
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lazy-loading 'resources' on Instance uuid 9a367ef3-2818-4c3a-b891-5d222491cdde {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-952064225',display_name='tempest-ServersNegativeTestJSON-server-952064225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-952064225',id=16,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:26:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50446b42a4644f398b94f86d0165d7f8',ramdisk_id='',reservation_id='r-5ola1kzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-715001397',owner_user_name='tempest-ServersNegativeTestJSON-715001397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:26:03Z,user_data=None,user_id='fed9425a174047c3b989c98682710c46',uuid=9a367ef3-2818-4c3a-b891-5d222491cdde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converting VIF {"id": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "address": "fa:16:3e:e1:38:74", "network": {"id": "b0458cae-2339-4a7c-a204-42fbb5121c19", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1255236454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50446b42a4644f398b94f86d0165d7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9dbe62b-cd", "ovs_interfaceid": "c9dbe62b-cd0b-4353-969d-59309eee69c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG os_vif [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9dbe62b-cd, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8cc7c00-f68f-4623-b28a-2f26b43f50a5) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:42 user nova-compute[86931]: INFO os_vif [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:38:74,bridge_name='br-int',has_traffic_filtering=True,id=c9dbe62b-cd0b-4353-969d-59309eee69c5,network=Network(b0458cae-2339-4a7c-a204-42fbb5121c19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9dbe62b-cd')
Nov 16 19:34:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Deleting instance files /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde_del
Nov 16 19:34:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Deletion of /opt/stack/data/nova/instances/9a367ef3-2818-4c3a-b891-5d222491cdde_del complete
Nov 16 19:34:42 user nova-compute[86931]: INFO nova.compute.manager [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:42 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Took 0.40 seconds to deallocate network for instance.
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-ea4d1001-634f-4122-8a91-0fbce2882ce7 req-67a10dfa-3f8d-45be-984b-73b17d0c128c service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-deleted-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:43 user nova-compute[86931]: INFO nova.compute.manager [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attaching volume 8785b913-9cdc-41df-aadc-156f6c78b1b1 to /dev/vdb
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d0da90-0d4e-48e3-8d85-b6fef68aa650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:43 user nova-compute[86931]: INFO nova.compute.manager [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Detaching volume ab69a63d-2ce6-4723-abb5-1763abd7df3f
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[689788b2-1c27-417b-ae5f-1a7c1dcdb0e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecada833-146c-4154-b05b-cb6b11fc9daf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[96866f21-71eb-4f59-9453-556630b2ae10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:43 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda1dd6-8899-41ea-91af-cb7638323adb]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating existing volume attachment record: 9eb11a13-ea7b-40b4-8723-9c7c585b6058 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:34:43 user nova-compute[86931]: INFO nova.virt.block_device [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attempting to driver detach volume ab69a63d-2ce6-4723-abb5-1763abd7df3f from mountpoint /dev/vdb
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Attempting to detach device vdb from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:34:43 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:43 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:34:43 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:43 user nova-compute[86931]:   <serial>ab69a63d-2ce6-4723-abb5-1763abd7df3f</serial>
Nov 16 19:34:43 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:34:43 user nova-compute[86931]: </disk>
Nov 16 19:34:43 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:34:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdb from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the persistent domain config.
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:34:43 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:43 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:34:43 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:43 user nova-compute[86931]:   <serial>ab69a63d-2ce6-4723-abb5-1763abd7df3f</serial>
Nov 16 19:34:43 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:34:43 user nova-compute[86931]: </disk>
Nov 16 19:34:43 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:43 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Deleted allocations for instance 9a367ef3-2818-4c3a-b891-5d222491cdde
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1e77bd1d-2053-44c1-85c0-ae795d1323fb tempest-ServersNegativeTestJSON-715001397 tempest-ServersNegativeTestJSON-715001397-project-member] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] Acquiring lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] Lock "9a367ef3-2818-4c3a-b891-5d222491cdde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] No waiting events found dispatching network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:43 user nova-compute[86931]: WARNING nova.compute.manager [req-cbd55851-39ca-45f2-b8e2-b6ffe4229dbe req-7bbf3c72-9ef9-4f3b-87dc-ed4ca788d4b1 service nova] [instance: 9a367ef3-2818-4c3a-b891-5d222491cdde] Received unexpected event network-vif-plugged-c9dbe62b-cd0b-4353-969d-59309eee69c5 for instance with vm_state deleted and task_state None.
Nov 16 19:34:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:34:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:34:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:34:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:46 user nova-compute[86931]: INFO nova.compute.manager [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Terminating instance
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-38f4db27-4412-4554-b2ca-79ba2edee4f7 req-1bc5cfe9-3f01-46e0-8232-7f0e1012b49d service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-unplugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:34:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Instance destroyed successfully.
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lazy-loading 'resources' on Instance uuid 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:26:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1168467223',display_name='tempest-ServerActionsTestOtherB-server-1168467223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1168467223',id=18,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTunQ32OG9KHvejB6ri22TCfMpGzqKRsFVFYKVJmYOvFa/PQJGFPUxcOakYsZFMvXbXgCpKsrxI2VL5stGl2hI1oZAUlJ+8TnyDJc4l7e11apu2vFI8Z54pFeaPaYkDmw==',key_name='tempest-keypair-563282352',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:32:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cd8e208b65450bbf83ee548609db34',ramdisk_id='',reservation_id='r-i7il80gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1844657466',owner_user_name='tempest-ServerActionsTestOtherB-1844657466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a76c0f9be3748ab9891d17446fb9ee4',uuid=4dfb53cd-4239-4cea-80d5-ecd6ac8ed200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converting VIF {"id": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "address": "fa:16:3e:74:67:94", "network": {"id": "c7272f8c-8698-4992-a70b-1e091ca6edee", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-810179958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cd8e208b65450bbf83ee548609db34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec0dd494-b4", "ovs_interfaceid": "ec0dd494-b4da-48ce-bfff-a77b0e3d2e69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_vif [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec0dd494-b4, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10d3adbd-8a25-46f5-90d2-0e9bfa9de9f0) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:34:47 user nova-compute[86931]: INFO os_vif [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:67:94,bridge_name='br-int',has_traffic_filtering=True,id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69,network=Network(c7272f8c-8698-4992-a70b-1e091ca6edee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec0dd494-b4')
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XzuqynsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:47 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9067e78-fffc-4842-8531-a68b54cc6842]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:34:47 user nova-compute[86931]: No targets found.
Nov 16 19:34:47 user nova-compute[86931]: iSNS:
Nov 16 19:34:47 user nova-compute[86931]: No targets found.
Nov 16 19:34:47 user nova-compute[86931]: STATIC:
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:34:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:34:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:34:47 user nova-compute[86931]: FIRMWARE:
Nov 16 19:34:47 user nova-compute[86931]: No targets found.
Nov 16 19:34:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:34:47 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:34:47 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ad1e7-bdd5-4b09-bef0-ecb5b4c0704d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc9f3a-f16b-4375-b075-60621409162d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:47 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760557e-2349-44c0-8c6a-41b6ed48633a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146d4ec-9c1a-40db-badb-c496d4f24479]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1da5c2b-dd82-4870-bb83-27decf9b9123]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b9da6-e5e7-4e13-85b8-470031bbec70]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b6057-3961-4b5b-9eec-5027e362c61a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a726b-e7a8-4ee1-952b-ab59b9eca770]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260]
Nov 16 19:34:47 user nova-compute[86931]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bde119e-a77d-4827-ad77-02b4dbb12877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5519d8-d1f4-4fc9-b633-4a347d997a7f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] <== disconnect_volume: return (394ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:34:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Deleting instance files /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_del
Nov 16 19:34:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Deletion of /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200_del complete
Nov 16 19:34:47 user nova-compute[86931]: INFO nova.compute.manager [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json" returned: 1 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk --force-share --output=json' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:34:47 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000012, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/4dfb53cd-4239-4cea-80d5-ecd6ac8ed200/disk
Nov 16 19:34:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-19438a70-690b-41e4-b3fa-b09015932d6d req-71570591-346e-456d-a55d-470df041ba16 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-deleted-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:48 user nova-compute[86931]: INFO nova.compute.manager [req-19438a70-690b-41e4-b3fa-b09015932d6d req-71570591-346e-456d-a55d-470df041ba16 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Neutron deleted interface ec0dd494-b4da-48ce-bfff-a77b0e3d2e69; detaching it from the instance and deleting it from the info cache
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-19438a70-690b-41e4-b3fa-b09015932d6d req-71570591-346e-456d-a55d-470df041ba16 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:34:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Took 0.78 seconds to deallocate network for instance.
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-19438a70-690b-41e4-b3fa-b09015932d6d req-71570591-346e-456d-a55d-470df041ba16 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Detach interface failed, port_id=ec0dd494-b4da-48ce-bfff-a77b0e3d2e69, reason: Instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] Acquiring lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] No waiting events found dispatching network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:34:48 user nova-compute[86931]: WARNING nova.compute.manager [req-c3639636-18e4-4409-b562-499bed66dce5 req-d2c61310-d877-4a98-870d-71f8735864e5 service nova] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Received unexpected event network-vif-plugged-ec0dd494-b4da-48ce-bfff-a77b0e3d2e69 for instance with vm_state active and task_state deleting.
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSeHkuKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:34:49 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:49 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:34:49 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec00004c-60d6-4551-b57c-63d1fd99ab70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:34:49 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aa0d8f-c2e4-4b93-ae07-09b4aa6f5559]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1] added
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[98888060-5350-4876-9bf4-3ebe9daecc27]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[583eeda0-3cdd-40ea-b821-31055d5f24cd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSeHkuKI {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSeHkuKI" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1119817-a779-4147-a182-c386ada843ce]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VSeHkuKI'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b109ff86-3c95-4a88-8ccd-089843f7ee8a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606bdb1-8cdf-4343-8fda-e60ec2f7f376]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c298c-bd53-43bb-bb9e-2fa951bbb51b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260]
Nov 16 19:34:49 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260] successful.
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: INFO nova.compute.manager [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] [instance: 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200] Took 0.83 seconds to detach 1 volumes for instance.
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f525b7e-da53-4526-9653-52f6778a0abb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[60daf3ac-a736-40a8-96b7-8e613cf07eb8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:34:49 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:34:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[885aa1bf-8805-49d9-9ba1-724804313068]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSeHkuKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:50 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Deleted allocations for instance 4dfb53cd-4239-4cea-80d5-ecd6ac8ed200
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e6c902bf-d0b1-40b0-922b-5a97474dd3ef tempest-ServerActionsTestOtherB-1844657466 tempest-ServerActionsTestOtherB-1844657466-project-member] Lock "4dfb53cd-4239-4cea-80d5-ecd6ac8ed200" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.768s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.673s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== connect_volume: return (1675ms) {'type': 'block', 'scsi_wwn': '23435336534376630', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435336534376630', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:34:50 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:50 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.227184295654297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:34:50 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:50 user nova-compute[86931]:   <source dev="/dev/sde"/>
Nov 16 19:34:50 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:50 user nova-compute[86931]:   <serial>8785b913-9cdc-41df-aadc-156f6c78b1b1</serial>
Nov 16 19:34:50 user nova-compute[86931]: </disk>
Nov 16 19:34:50 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 64be39ba-20af-46b5-94d7-bec4c08a4775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:34:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No VIF found with MAC fa:16:3e:63:da:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d39b1045-1f88-4098-9205-46219f807b02 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.418s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:34:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:34:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:34:53 user nova-compute[86931]: INFO nova.compute.manager [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Detaching volume 8785b913-9cdc-41df-aadc-156f6c78b1b1
Nov 16 19:34:53 user nova-compute[86931]: INFO nova.virt.block_device [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attempting to driver detach volume 8785b913-9cdc-41df-aadc-156f6c78b1b1 from mountpoint /dev/vdb
Nov 16 19:34:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Attempting to detach device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:34:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:34:53 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:53 user nova-compute[86931]:   <source dev="/dev/sde"/>
Nov 16 19:34:53 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:53 user nova-compute[86931]:   <serial>8785b913-9cdc-41df-aadc-156f6c78b1b1</serial>
Nov 16 19:34:53 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:34:53 user nova-compute[86931]: </disk>
Nov 16 19:34:53 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:34:53 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config.
Nov 16 19:34:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:34:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:34:53 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:34:53 user nova-compute[86931]:   <source dev="/dev/sde"/>
Nov 16 19:34:53 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:34:53 user nova-compute[86931]:   <serial>8785b913-9cdc-41df-aadc-156f6c78b1b1</serial>
Nov 16 19:34:53 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:34:53 user nova-compute[86931]: </disk>
Nov 16 19:34:53 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:34:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:34:54 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:54 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:34:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:34:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing instance network info cache due to event network-changed-98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Refreshing network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:35:03 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b is timed out.
Nov 16 19:35:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdb from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the live domain config.
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAKMrNft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:03 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b483cfc-6593-472b-9aae-f7645055b267]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:35:03 user nova-compute[86931]: No targets found.
Nov 16 19:35:03 user nova-compute[86931]: iSNS:
Nov 16 19:35:03 user nova-compute[86931]: No targets found.
Nov 16 19:35:03 user nova-compute[86931]: STATIC:
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:35:03 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:03 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:03 user nova-compute[86931]: FIRMWARE:
Nov 16 19:35:03 user nova-compute[86931]: No targets found.
Nov 16 19:35:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:35:03 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:35:03 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated VIF entry in instance network info cache for port 98c5d767-24e5-4f04-983e-d217b97d29e6. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605448f-b481-42a5-86c6-43129b7eca63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-077d6287-1b6c-417c-a918-7dad70837928 req-35d9b92c-a019-4420-b2c3-de3ad6895b69 service nova] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e19391-73b3-4605-9efa-05830d9799bb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:03 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa6661f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9c18b8-bcb4-433d-9e61-fe621a043a8f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e0289-3f3c-45bd-86dd-b5e524ed5aab]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f426bf07-1c6b-4fce-a917-f6479f99f674]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:35:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde971f-105d-4c5c-bc35-039e73bf51b7]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b25a17-c5a8-445b-95dd-86cf2c09fd72]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a1c2c-5ee9-4b0f-ad1d-18c719ff972a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260]
Nov 16 19:35:04 user nova-compute[86931]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab69a63d-2ce6-4723-abb5-1763abd7df3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed11537-246c-4dda-b9dd-4ac0f441305b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== disconnect_volume: return (349ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Stashing vm_state: active {{(pid=86931) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:35:04 user nova-compute[86931]: INFO nova.compute.claims [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Claim successful on node user
Nov 16 19:35:04 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating resource usage from migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9
Nov 16 19:35:04 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b96392af-d843-4d21-8b3c-4e3c6d65c5d7 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.406s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:05 user nova-compute[86931]: INFO nova.compute.manager [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Migrating
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-changed-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Refreshing instance network info cache due to event network-changed-5418fbbb-8075-4eca-85f9-5a551f788b8c. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Refreshing network info cache for port 5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Starting migrate_disk_and_power_off {{(pid=86931) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:05 user nova-compute[86931]: INFO nova.compute.manager [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Detaching volume 1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:35:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:05 user nova-compute[86931]: INFO nova.virt.block_device [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Attempting to driver detach volume 1e714924-5f48-419e-9809-6791d102a81b from mountpoint /dev/vdc
Nov 16 19:35:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Attempting to detach device vdc from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:35:05 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:05 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:35:05 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:35:05 user nova-compute[86931]:   <serial>1e714924-5f48-419e-9809-6791d102a81b</serial>
Nov 16 19:35:05 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:35:05 user nova-compute[86931]: </disk>
Nov 16 19:35:05 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:35:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdc from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the persistent domain config.
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:35:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:35:05 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:05 user nova-compute[86931]:   <source dev="/dev/sdh"/>
Nov 16 19:35:05 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:35:05 user nova-compute[86931]:   <serial>1e714924-5f48-419e-9809-6791d102a81b</serial>
Nov 16 19:35:05 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:35:05 user nova-compute[86931]: </disk>
Nov 16 19:35:05 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updated VIF entry in instance network info cache for port 5418fbbb-8075-4eca-85f9-5a551f788b8c. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1293e5e2-fd66-4116-b485-156f78e5247a req-32a9dfd0-50dd-4d9b-b83e-7f2fd471bd00 service nova] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:35:06 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance destroyed successfully.
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5418fbbb-80, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10631d27-edea-42ef-8fc0-39e8d9cda28b) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: INFO os_vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80')
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:06 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc54598-6a99-4b54-9396-ca50efcf36ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:35:06 user nova-compute[86931]: No targets found.
Nov 16 19:35:06 user nova-compute[86931]: iSNS:
Nov 16 19:35:06 user nova-compute[86931]: No targets found.
Nov 16 19:35:06 user nova-compute[86931]: STATIC:
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:35:06 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:06 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:06 user nova-compute[86931]: FIRMWARE:
Nov 16 19:35:06 user nova-compute[86931]: No targets found.
Nov 16 19:35:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:35:06 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:35:06 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7514b-2787-4f86-8132-1171d6fc7722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5f7de-9f56-4832-ad37-57a33481afbd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:06 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c601480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1056e7a8-6d64-4673-a4a2-378f7a70a430]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b7905-0236-466c-a148-61968b1850f6]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b0d5f5-a815-4120-a845-e8cb3b2fa3ef]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[369ecfbb-4cb4-42a4-8407-53e6507d115c]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23535656266353465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1a8ba48', '/dev/disk/by-id/scsi-1SCST_BIOd1a8ba48-55ebf54e8d876c28') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d0bd1-7977-439d-88e9-ca3bc9e98f53]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a6db6-694f-4820-a004-3a80b8692976]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[07098f7e-2421-49e0-887f-089df668dd1a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]
Nov 16 19:35:06 user nova-compute[86931]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a5a5e8-67bd-4bbe-9553-a3cc87cc92d3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== disconnect_volume: return (348ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:35:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:07 user nova-compute[86931]: WARNING nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state resize_migrating.
Nov 16 19:35:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:07 user nova-compute[86931]: WARNING nova.compute.manager [req-b9b598f0-259f-4a4c-a69a-1a835220462d req-d757c8a6-05e5-4256-85a2-4472ea560caf service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state resize_migrating.
Nov 16 19:35:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Port 5418fbbb-8075-4eca-85f9-5a551f788b8c binding to destination host user is already ACTIVE {{(pid=86931) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.utils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a36439-43a2-4955-aedc-342a8530d53a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4990a8d0-20f1-4317-9e4e-c561fa11a89e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61151e5-0aff-49d8-9d70-c5b2b82bf2e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1afa2d-6aa4-49eb-b792-bb9a321e414a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:35:08 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:35:08 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c61e640-edf6-42db-a87d-84c0bcd30364]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:35:08 user nova-compute[86931]: DEBUG os_brick.utils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:11 user nova-compute[86931]: INFO nova.compute.manager [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Rescuing
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:11 user nova-compute[86931]: WARNING nova.compute.manager [req-219490a5-fb8e-42d8-9857-2a9482f2198d req-f5098aeb-1004-4e8d-bf0c-954c40f782d2 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance destroyed successfully.
Nov 16 19:35:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Attempting a stable device rescue
Nov 16 19:35:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:35:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Creating image(s)
Nov 16 19:35:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.compute.manager [req-21a5788e-aace-4a34-b27e-f1fbdc9b941a req-9c0d144d-dcd5-4d26-a200-8f8a15716eff service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:13 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b is timed out.
Nov 16 19:35:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config.
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSeHkuKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:13 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ae8cd6-12c6-47f6-b8dd-df16aeb70891]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:35:13 user nova-compute[86931]: No targets found.
Nov 16 19:35:13 user nova-compute[86931]: iSNS:
Nov 16 19:35:13 user nova-compute[86931]: No targets found.
Nov 16 19:35:13 user nova-compute[86931]: STATIC:
Nov 16 19:35:13 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1
Nov 16 19:35:13 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:13 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:13 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:35:13 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:13 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:13 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:35:13 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:13 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:13 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:35:13 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:13 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:13 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:35:13 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:13 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:13 user nova-compute[86931]: FIRMWARE:
Nov 16 19:35:13 user nova-compute[86931]: No targets found.
Nov 16 19:35:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:35:13 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:35:13 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.part --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.virt.images [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] 42fd10a7-534d-4c96-9e05-dbabdbf7b3e0 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.part /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee96d4c-4ac2-4643-8f8f-d971428c4546]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[346dca94-1dcb-4c87-9852-468561505f9a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c677d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b02799-7694-41bc-993c-58e70401eb15]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c3f83e-20f7-422c-aa15-cc604fc34b2f]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a80fef-c8c6-4f08-bb92-81ea85635966]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f31c55-f6be-498c-80fc-f1ab6a5336c2]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Starting finish_migration {{(pid=86931) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:35:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Creating image(s)
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Ensure instance console log exists: /opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start _get_guest_xml network_info=[{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '421a3d47-11d9-4241-9c4d-139d7008c678', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '105dd9f1-9f20-4f05-8dd4-ad360886dc09', 'attached_at': '2023-11-16T19:35:14.000000', 'detached_at': '', 'volume_id': '7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'serial': '7b776c46-7cd7-4ceb-ba82-46f23fdd9989'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdcc2fd-acd4-48ac-b9ce-06e045a99221]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:14 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.152s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2c1a0-8ea6-4fc4-bebc-89f2dd7dba1c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260]
Nov 16 19:35:14 user nova-compute[86931]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8785b913-9cdc-41df-aadc-156f6c78b1b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[17221c1a-53fc-40cd-8771-483cdb45754f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== disconnect_volume: return (454ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.142s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:14 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:14 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42c5393-2103-4d9f-ad11-3b7ec9edd3d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:35:14 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea999eb-e552-4e68-8afa-2201a955cfad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989] added
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8bbac1-3a13-4431-867a-4137d44f9d17]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.part /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.converted" returned: 0 in 0.521s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4760f-1e8c-4912-9951-4d7dd0044dc9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utyxqFhI {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utyxqFhI" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c54363-3160-4cf4-a4bd-7df4e6c50d3e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utyxqFhI'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a9b771-6821-47e1-bf27-54e2eb4c3927]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66371ce-e37c-45c8-8ba4-b5ab98ed478e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d968a45-30ba-49d8-8f21-384c38db7269]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]
Nov 16 19:35:14 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.388s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e66ab-03e9-44f4-9022-a6a69d2724e3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b03f17-2cf7-4dce-998d-fdf2551214d9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:14 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07bd46-e8b9-4dbf-aab6-5950bf4d4308]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce,backing_fmt=raw /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce,backing_fmt=raw /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue" returned: 0 in 0.049s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "c66db38d103e721396c71f0d3a845a9ab924d5ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'migration_context' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<3f799e54-3a33-4e78-b043-dce4e012701f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start _get_guest_xml network_info=[{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:72:3e:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '42fd10a7-534d-4c96-9e05-dbabdbf7b3e0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'bf13ea1c-7d5b-40c8-93cc-4c7278a47de3', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3f799e54-3a33-4e78-b043-dce4e012701f', 'attached_at': '', 'detached_at': '', 'volume_id': '9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'serial': '9161aa5a-0600-4b27-a9bf-04cf5708b67e'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<3f799e54-3a33-4e78-b043-dce4e012701f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<3f799e54-3a33-4e78-b043-dce4e012701f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:35:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:35:14 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.objects.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<3f799e54-3a33-4e78-b043-dce4e012701f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:15 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ffa747fe-76f8-4a3f-8e54-eec4df6bec98 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== connect_volume: return (1547ms) {'type': 'block', 'scsi_wwn': '23535656266353465', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535656266353465', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.764s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:15 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:15 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:35:15 user nova-compute[86931]:   <uuid>105dd9f1-9f20-4f05-8dd4-ad360886dc09</uuid>
Nov 16 19:35:15 user nova-compute[86931]:   <name>instance-0000001a</name>
Nov 16 19:35:15 user nova-compute[86931]:   <memory>2097152</memory>
Nov 16 19:35:15 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:35:15 user nova-compute[86931]:   <metadata>
Nov 16 19:35:15 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:35:15 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:35:15 user nova-compute[86931]:       <nova:name>tempest-ServerActionsTestOtherA-server-105731436</nova:name>
Nov 16 19:35:15 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:35:14</nova:creationTime>
Nov 16 19:35:15 user nova-compute[86931]:       <nova:flavor name="m1.small">
Nov 16 19:35:15 user nova-compute[86931]:         <nova:memory>2048</nova:memory>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:disk>20</nova:disk>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:35:15 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:35:15 user nova-compute[86931]:       <nova:owner>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:user uuid="c74086febf834740bbe6d094ebad864b">tempest-ServerActionsTestOtherA-672558396-project-member</nova:user>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:project uuid="823d93d9aed54ef0aac913d3707f207f">tempest-ServerActionsTestOtherA-672558396</nova:project>
Nov 16 19:35:15 user nova-compute[86931]:       </nova:owner>
Nov 16 19:35:15 user nova-compute[86931]:       <nova:ports>
Nov 16 19:35:15 user nova-compute[86931]:         <nova:port uuid="5418fbbb-8075-4eca-85f9-5a551f788b8c">
Nov 16 19:35:15 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 19:35:15 user nova-compute[86931]:         </nova:port>
Nov 16 19:35:15 user nova-compute[86931]:       </nova:ports>
Nov 16 19:35:15 user nova-compute[86931]:     </nova:instance>
Nov 16 19:35:15 user nova-compute[86931]:   </metadata>
Nov 16 19:35:15 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:35:15 user nova-compute[86931]:     <system>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="serial">105dd9f1-9f20-4f05-8dd4-ad360886dc09</entry>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="uuid">105dd9f1-9f20-4f05-8dd4-ad360886dc09</entry>
Nov 16 19:35:15 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:35:15 user nova-compute[86931]:     </system>
Nov 16 19:35:15 user nova-compute[86931]:   </sysinfo>
Nov 16 19:35:15 user nova-compute[86931]:   <os>
Nov 16 19:35:15 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:35:15 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:35:15 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:35:15 user nova-compute[86931]:   </os>
Nov 16 19:35:15 user nova-compute[86931]:   <features>
Nov 16 19:35:15 user nova-compute[86931]:     <acpi/>
Nov 16 19:35:15 user nova-compute[86931]:     <apic/>
Nov 16 19:35:15 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:35:15 user nova-compute[86931]:   </features>
Nov 16 19:35:15 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:35:15 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:35:15 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:35:15 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:35:15 user nova-compute[86931]:   </clock>
Nov 16 19:35:15 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:35:15 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:35:15 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:35:15 user nova-compute[86931]:   </cpu>
Nov 16 19:35:15 user nova-compute[86931]:   <devices>
Nov 16 19:35:15 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:35:15 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:15 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:35:15 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:35:15 user nova-compute[86931]:       <serial>7b776c46-7cd7-4ceb-ba82-46f23fdd9989</serial>
Nov 16 19:35:15 user nova-compute[86931]:     </disk>
Nov 16 19:35:15 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:35:15 user nova-compute[86931]:       <mac address="fa:16:3e:3d:3a:76"/>
Nov 16 19:35:15 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:15 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:35:15 user nova-compute[86931]:       <target dev="tap5418fbbb-80"/>
Nov 16 19:35:15 user nova-compute[86931]:     </interface>
Nov 16 19:35:15 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:35:15 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09/console.log" append="off"/>
Nov 16 19:35:15 user nova-compute[86931]:     </serial>
Nov 16 19:35:15 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:35:15 user nova-compute[86931]:     <video>
Nov 16 19:35:15 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:15 user nova-compute[86931]:     </video>
Nov 16 19:35:15 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:35:15 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:35:15 user nova-compute[86931]:     </rng>
Nov 16 19:35:15 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:35:15 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:35:15 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:35:15 user nova-compute[86931]:     </memballoon>
Nov 16 19:35:15 user nova-compute[86931]:   </devices>
Nov 16 19:35:15 user nova-compute[86931]: </domain>
Nov 16 19:35:15 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1529572332-network", "vif_mac": "fa:16:3e:3d:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[93739240-39dd-4bd9-96f8-146fbd7a0a0f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YKCcSAjV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 19:35:15 user nova-compute[86931]: node.name = iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:35:15 user nova-compute[86931]: node.tpgt = -1
Nov 16 19:35:15 user nova-compute[86931]: node.startup = automatic
Nov 16 19:35:15 user nova-compute[86931]: node.leading_login = No
Nov 16 19:35:15 user nova-compute[86931]: iface.iscsi_ifacename = default
Nov 16 19:35:15 user nova-compute[86931]: iface.net_ifacename = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.ipaddress = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.prefix_len = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.hwaddress = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.transport_name = tcp
Nov 16 19:35:15 user nova-compute[86931]: iface.initiatorname = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.vlan_id = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.vlan_priority = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.vlan_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.iface_num = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.mtu = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.port = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.bootproto = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.subnet_mask = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.gateway = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_alt_client_id = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_dns = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_learn_iqn = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_vendor_id_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_vendor_id = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.dhcp_slp_da = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.fragmentation = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.gratuitous_arp = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.incoming_forwarding = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.tos_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.tos = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.ttl = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.delayed_ack = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.tcp_nagle = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.tcp_wsf_state = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.tcp_wsf = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.tcp_timer_scale = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.tcp_timestamp = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.redirect = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.def_task_mgmt_timeout = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.header_digest = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.data_digest = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.immediate_data = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.initial_r2t = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.data_seq_inorder = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.data_pdu_inorder = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.erl = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.max_receive_data_len = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.first_burst_len = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.max_outstanding_r2t = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.max_burst_len = 0
Nov 16 19:35:15 user nova-compute[86931]: iface.chap_auth = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.bidi_chap = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.strict_login_compliance = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.discovery_auth = <empty>
Nov 16 19:35:15 user nova-compute[86931]: iface.discovery_logout = <empty>
Nov 16 19:35:15 user nova-compute[86931]: node.discovery_address = <empty>
Nov 16 19:35:15 user nova-compute[86931]: node.discovery_port = 0
Nov 16 19:35:15 user nova-compute[86931]: node.discovery_type = static
Nov 16 19:35:15 user nova-compute[86931]: node.session.initial_cmdsn = 0
Nov 16 19:35:15 user nova-compute[86931]: node.session.initial_login_retry_max = 8
Nov 16 19:35:15 user nova-compute[86931]: node.session.xmit_thread_priority = -20
Nov 16 19:35:15 user nova-compute[86931]: node.session.cmds_max = 128
Nov 16 19:35:15 user nova-compute[86931]: node.session.queue_depth = 32
Nov 16 19:35:15 user nova-compute[86931]: node.session.nr_sessions = 1
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.authmethod = CHAP
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.username = YKCcSAjV
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.password = ***
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.username_in = <empty>
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.password_in = <empty>
Nov 16 19:35:15 user nova-compute[86931]: node.session.auth.chap_algs = MD5
Nov 16 19:35:15 user nova-compute[86931]: node.session.timeo.replacement_timeout = 120
Nov 16 19:35:15 user nova-compute[86931]: node.session.err_timeo.abort_timeout = 15
Nov 16 19:35:15 user nova-compute[86931]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 19:35:15 user nova-compute[86931]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 19:35:15 user nova-compute[86931]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.FastAbort = Yes
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.InitialR2T = No
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.ImmediateData = Yes
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.MaxConnections = 1
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 19:35:15 user nova-compute[86931]: node.session.iscsi.ERL = 0
Nov 16 19:35:15 user nova-compute[86931]: node.session.scan = manual
Nov 16 19:35:15 user nova-compute[86931]: node.session.reopen_max = 0
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].address = 172.16.0.220
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].port = 3260
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].startup = manual
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].tcp.window_size = 524288
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].tcp.type_of_service = 0
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].timeo.logout_timeout = 15
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].timeo.login_timeout = 15
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].timeo.auth_timeout = 45
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.DataDigest = None
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.IFMarker = No
Nov 16 19:35:15 user nova-compute[86931]: node.conn[0].iscsi.OFMarker = No
Nov 16 19:35:15 user nova-compute[86931]: # END RECORD
Nov 16 19:35:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f9f21a0-013d-5a7e-8680-9cc4ad6a8be4', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5418fbbb-80, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5418fbbb-80, col_values=(('qos', UUID('9daf398f-0199-4801-b6b9-353e9b141c27')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5418fbbb-80, col_values=(('external_ids', {'iface-id': '5418fbbb-8075-4eca-85f9-5a551f788b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:3a:76', 'vm-uuid': '105dd9f1-9f20-4f05-8dd4-ad360886dc09'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[21629c0d-c2fc-4db1-af06-aa2b46c71fc9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:15 user nova-compute[86931]: INFO os_vif [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80')
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6dd116-d5f2-4e36-a215-5b683356cfd0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKCcSAjV {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YKCcSAjV" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a683ae-e6f4-4585-80c5-0cbbae1d02c8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YKCcSAjV'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f76893-16d2-4873-8de1-6cbf9735878c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] No VIF found with MAC fa:16:3e:3d:3a:76, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0673e7d2-b88b-4c9a-8eaa-13fdcd5f798f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:15 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] HCTL ('37', '0', '0', 0) found on session 35 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a3f68-6278-461f-9369-b0301eec8b1a]: (4, ('0 0 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Searching for a device in session 35 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== connect_volume: return (958ms) {'type': 'block', 'scsi_wwn': '23731393536653536', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731393536653536', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910491494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910491494',id=27,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-ykgsiy3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:33:44Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=3f799e54-3a33-4e78-b043-dce4e012701f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:72:3e:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "vif_mac": "fa:16:3e:72:3e:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.objects.base [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Object Instance<3f799e54-3a33-4e78-b043-dce4e012701f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:35:16 user nova-compute[86931]:   <uuid>3f799e54-3a33-4e78-b043-dce4e012701f</uuid>
Nov 16 19:35:16 user nova-compute[86931]:   <name>instance-0000001b</name>
Nov 16 19:35:16 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:35:16 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:35:16 user nova-compute[86931]:   <metadata>
Nov 16 19:35:16 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:35:16 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1910491494</nova:name>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:35:14</nova:creationTime>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:35:16 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:35:16 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:owner>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:user uuid="3c8c15e0597f411f81270cd3b181043b">tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member</nova:user>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:project uuid="97456514d9f541ec936e509c558e60db">tempest-ServerBootFromVolumeStableRescueTest-1979208680</nova:project>
Nov 16 19:35:16 user nova-compute[86931]:       </nova:owner>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:35:16 user nova-compute[86931]:       <nova:ports>
Nov 16 19:35:16 user nova-compute[86931]:         <nova:port uuid="538e3e11-ab42-42f7-97cf-0a3a56755514">
Nov 16 19:35:16 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 19:35:16 user nova-compute[86931]:         </nova:port>
Nov 16 19:35:16 user nova-compute[86931]:       </nova:ports>
Nov 16 19:35:16 user nova-compute[86931]:     </nova:instance>
Nov 16 19:35:16 user nova-compute[86931]:   </metadata>
Nov 16 19:35:16 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:35:16 user nova-compute[86931]:     <system>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="serial">3f799e54-3a33-4e78-b043-dce4e012701f</entry>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="uuid">3f799e54-3a33-4e78-b043-dce4e012701f</entry>
Nov 16 19:35:16 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:35:16 user nova-compute[86931]:     </system>
Nov 16 19:35:16 user nova-compute[86931]:   </sysinfo>
Nov 16 19:35:16 user nova-compute[86931]:   <os>
Nov 16 19:35:16 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:35:16 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:35:16 user nova-compute[86931]:   </os>
Nov 16 19:35:16 user nova-compute[86931]:   <features>
Nov 16 19:35:16 user nova-compute[86931]:     <acpi/>
Nov 16 19:35:16 user nova-compute[86931]:     <apic/>
Nov 16 19:35:16 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:35:16 user nova-compute[86931]:   </features>
Nov 16 19:35:16 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:35:16 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:35:16 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:35:16 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:35:16 user nova-compute[86931]:   </clock>
Nov 16 19:35:16 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:35:16 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:35:16 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:35:16 user nova-compute[86931]:   </cpu>
Nov 16 19:35:16 user nova-compute[86931]:   <devices>
Nov 16 19:35:16 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:35:16 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:16 user nova-compute[86931]:       <source dev="/dev/sdf"/>
Nov 16 19:35:16 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:35:16 user nova-compute[86931]:       <serial>9161aa5a-0600-4b27-a9bf-04cf5708b67e</serial>
Nov 16 19:35:16 user nova-compute[86931]:     </disk>
Nov 16 19:35:16 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:35:16 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:35:16 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue"/>
Nov 16 19:35:16 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:35:16 user nova-compute[86931]:       <boot order="1"/>
Nov 16 19:35:16 user nova-compute[86931]:     </disk>
Nov 16 19:35:16 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:35:16 user nova-compute[86931]:       <mac address="fa:16:3e:72:3e:5d"/>
Nov 16 19:35:16 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:16 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:35:16 user nova-compute[86931]:       <target dev="tap538e3e11-ab"/>
Nov 16 19:35:16 user nova-compute[86931]:     </interface>
Nov 16 19:35:16 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:35:16 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/console.log" append="off"/>
Nov 16 19:35:16 user nova-compute[86931]:     </serial>
Nov 16 19:35:16 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:35:16 user nova-compute[86931]:     <video>
Nov 16 19:35:16 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:16 user nova-compute[86931]:     </video>
Nov 16 19:35:16 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:35:16 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:35:16 user nova-compute[86931]:     </rng>
Nov 16 19:35:16 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:35:16 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:35:16 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:35:16 user nova-compute[86931]:     </memballoon>
Nov 16 19:35:16 user nova-compute[86931]:   </devices>
Nov 16 19:35:16 user nova-compute[86931]: </domain>
Nov 16 19:35:16 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:35:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance destroyed successfully.
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] No VIF found with MAC fa:16:3e:72:3e:5d, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:18 user nova-compute[86931]: WARNING nova.compute.manager [req-a2bf359c-5b1d-4b50-92d3-b4bf42e782b3 req-0c340b7b-c7f0-43c6-bbec-eea313a1deee service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state resize_finish.
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:20 user nova-compute[86931]: WARNING nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state resize_finish.
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:20 user nova-compute[86931]: WARNING nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:20 user nova-compute[86931]: WARNING nova.compute.manager [req-1ca350e7-196e-401b-8f18-8bf731a46474 req-e54c2f1c-7c14-414a-887d-0968dd86a3fd service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state rescuing.
Nov 16 19:35:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1a09f38b-03b2-4630-827e-f8658d328399 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:35:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance running successfully.
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Failed to set time: agent not configured {{(pid=86931) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 19:35:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4638d50-b97f-4f81-a9a2-cdd909b32fd6 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] finish_migration finished successfully. {{(pid=86931) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 19:35:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:26 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b is timed out.
Nov 16 19:35:26 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully detached device vdc from instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b from the live domain config.
Nov 16 19:35:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcCgZfmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:26 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dd96d2-65ab-41c3-8a9c-deb8ffa368c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:35:26 user nova-compute[86931]: No targets found.
Nov 16 19:35:26 user nova-compute[86931]: iSNS:
Nov 16 19:35:26 user nova-compute[86931]: No targets found.
Nov 16 19:35:26 user nova-compute[86931]: STATIC:
Nov 16 19:35:26 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b
Nov 16 19:35:26 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:26 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:26 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:35:26 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:26 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:26 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:35:26 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:26 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:26 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:35:26 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:26 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:26 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:35:26 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:35:26 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:35:26 user nova-compute[86931]: FIRMWARE:
Nov 16 19:35:26 user nova-compute[86931]: No targets found.
Nov 16 19:35:26 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:35:26 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:35:26 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3255ff1-d7ca-465b-9b2c-7c96f3daff62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03e6c3-a5d1-4746-b431-dd02e50eec4c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b (non-flash)
Nov 16 19:35:26 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:26 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5236d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b'): ({'sdh'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Removing single pathed devices sdh {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abff8d8-184b-4416-aa70-ee97a38c81da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0554e-f16a-4885-82b0-07410f924c2a]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Flushing IO for device /dev/sdh {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc974868-1085-48c5-a533-dc108eb09b0c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ce3aea-6c09-4fd9-a85e-c661358412b4]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] SCSI volumes sdh have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f7e85-421d-47b4-b2c0-105d1e380583]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee557df-3995-4ef6-87a9-06eedee680db]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260]
Nov 16 19:35:26 user nova-compute[86931]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:26 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e714924-5f48-419e-9809-6791d102a81b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9120db16-eeb7-426a-9342-d98a502368bb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] <== disconnect_volume: return (332ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:35:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'flavor' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a1761608-1a45-4eb1-8455-ced7f6e6b3d6 tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:28 user nova-compute[86931]: INFO nova.compute.manager [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Terminating instance
Nov 16 19:35:28 user nova-compute[86931]: DEBUG nova.compute.manager [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-unplugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] No waiting events found dispatching network-vif-unplugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-7e2cde10-d820-4d8e-ac4a-4dae506b60f6 req-109a6c64-507f-405f-8bcb-d54f0ee7a4a1 service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-unplugged-9f25a379-3b1a-4944-acba-51c2045aeefa for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:35:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Instance destroyed successfully.
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.objects.instance [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lazy-loading 'resources' on Instance uuid 31c09889-4a92-40bb-a037-b7c4a0e0ce2b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893478513',display_name='tempest-AttachVolumeTestJSON-server-1893478513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893478513',id=25,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJr2OH0l7k9txCZTt294ybm+y+l6IJ2DVnpmqOY1QIYdHH07BYWAeKRIcezZhX+1AIjyRpwjy0IDqAc9PtCa/WBnkBlarwUQQeXwzjk4SVDtqpMx3tM8bMZtAyhSHt1yA==',key_name='tempest-keypair-1074649478',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3cfa544a56b847afbf03a50f1e7603f2',ramdisk_id='',reservation_id='r-tgn2gr06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1412638370',owner_user_name='tempest-AttachVolumeTestJSON-1412638370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='608adfbbb5d74367a409c645ee871f6c',uuid=31c09889-4a92-40bb-a037-b7c4a0e0ce2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converting VIF {"id": "9f25a379-3b1a-4944-acba-51c2045aeefa", "address": "fa:16:3e:6d:7e:02", "network": {"id": "245955be-cda0-4a1f-9b5b-7be2bf72f510", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1722563705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3cfa544a56b847afbf03a50f1e7603f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f25a379-3b", "ovs_interfaceid": "9f25a379-3b1a-4944-acba-51c2045aeefa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG os_vif [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f25a379-3b, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a12a12c-2e97-4bc5-9106-58d3fe10f11e) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:29 user nova-compute[86931]: INFO os_vif [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:7e:02,bridge_name='br-int',has_traffic_filtering=True,id=9f25a379-3b1a-4944-acba-51c2045aeefa,network=Network(245955be-cda0-4a1f-9b5b-7be2bf72f510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f25a379-3b')
Nov 16 19:35:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Deleting instance files /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b_del
Nov 16 19:35:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Deletion of /opt/stack/data/nova/instances/31c09889-4a92-40bb-a037-b7c4a0e0ce2b_del complete
Nov 16 19:35:29 user nova-compute[86931]: INFO nova.compute.manager [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 16 19:35:29 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:35:29 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:35:30 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:30 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Took 0.66 seconds to deallocate network for instance.
Nov 16 19:35:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:31 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Deleted allocations for instance 31c09889-4a92-40bb-a037-b7c4a0e0ce2b
Nov 16 19:35:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8b07b566-85dc-43c6-be66-ef27280c5ece tempest-AttachVolumeTestJSON-1412638370 tempest-AttachVolumeTestJSON-1412638370-project-member] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] Acquiring lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] Lock "31c09889-4a92-40bb-a037-b7c4a0e0ce2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] No waiting events found dispatching network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:31 user nova-compute[86931]: WARNING nova.compute.manager [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received unexpected event network-vif-plugged-9f25a379-3b1a-4944-acba-51c2045aeefa for instance with vm_state deleted and task_state None.
Nov 16 19:35:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-4cc956d1-55be-48ae-9f2f-2e9661c31660 req-84c9d596-1e6c-4e86-beca-06faec89437a service nova] [instance: 31c09889-4a92-40bb-a037-b7c4a0e0ce2b] Received event network-vif-deleted-9f25a379-3b1a-4944-acba-51c2045aeefa {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:35:45 user nova-compute[86931]: INFO nova.compute.claims [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Claim successful on node user
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:35:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.policy [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7112607a7774345b8879d0422b8b94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ee3cb7b348423c81c90a733038d9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:35:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Creating image(s)
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk 1073741824" returned: 0 in 0.061s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Successfully created port: 3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Skipping network cache update for instance because it is Building. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 8d74eef2-f3a7-4063-95a5-4f13304c9d8f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:46 user nova-compute[86931]: INFO nova.compute.manager [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attaching volume dd864b25-54c0-447c-b37f-0e78778af42d to /dev/vdb
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Cannot resize image /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Ensure instance console log exists: /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG os_brick.utils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e32255-bf57-44af-b2dd-597fe31388e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[485b28a1-adde-402e-913d-a7749b8dff32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:46 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc57c19a-4d94-420e-87a5-c2375e977478]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd332433-0ad6-4d41-865a-77f2d30904a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:35:47 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a192c-67d5-42d2-8e40-c5a6a18cd7aa]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_brick.utils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating existing volume attachment record: a13bca6b-9c9e-44d4-8925-353bcd2d12e3 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Successfully updated port: 3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquired lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-changed-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Refreshing instance network info cache due to event network-changed-3a041c70-20e3-4bf5-a771-b64105c39036. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] Acquiring lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [{"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-8d74eef2-f3a7-4063-95a5-4f13304c9d8f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating instance_info_cache with network_info: [{"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Releasing lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Instance network_info: |[{"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] Acquired lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.neutron [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Refreshing network info cache for port 3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Start _get_guest_xml network_info=[{"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:35:47 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:47 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733279661',display_name='tempest-AttachVolumeNegativeTest-server-1733279661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733279661',id=30,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgIDEBTHw8LtzgfJ80dI+yBjTZjttZgNfFbSxYrSj3o+f6O3YJEqtwTnHN+2WXAYjPZZI/nZ1pUTrAl79+0yhQxiztLNsAwzZooGOiMdbvCoGsMzeizs809zf/SryaDkA==',key_name='tempest-keypair-1586161893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-fklqi0r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=ceb5e49c-ad73-48f0-bfe0-b8f18141818d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'pci_devices' on Instance uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:35:47 user nova-compute[86931]:   <uuid>ceb5e49c-ad73-48f0-bfe0-b8f18141818d</uuid>
Nov 16 19:35:47 user nova-compute[86931]:   <name>instance-0000001e</name>
Nov 16 19:35:47 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:35:47 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:35:47 user nova-compute[86931]:   <metadata>
Nov 16 19:35:47 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:35:47 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1733279661</nova:name>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:35:47</nova:creationTime>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:35:47 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:35:47 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:owner>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:user uuid="d7112607a7774345b8879d0422b8b94c">tempest-AttachVolumeNegativeTest-57450610-project-member</nova:user>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:project uuid="a3ee3cb7b348423c81c90a733038d9ff">tempest-AttachVolumeNegativeTest-57450610</nova:project>
Nov 16 19:35:47 user nova-compute[86931]:       </nova:owner>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:35:47 user nova-compute[86931]:       <nova:ports>
Nov 16 19:35:47 user nova-compute[86931]:         <nova:port uuid="3a041c70-20e3-4bf5-a771-b64105c39036">
Nov 16 19:35:47 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 19:35:47 user nova-compute[86931]:         </nova:port>
Nov 16 19:35:47 user nova-compute[86931]:       </nova:ports>
Nov 16 19:35:47 user nova-compute[86931]:     </nova:instance>
Nov 16 19:35:47 user nova-compute[86931]:   </metadata>
Nov 16 19:35:47 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:35:47 user nova-compute[86931]:     <system>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="serial">ceb5e49c-ad73-48f0-bfe0-b8f18141818d</entry>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="uuid">ceb5e49c-ad73-48f0-bfe0-b8f18141818d</entry>
Nov 16 19:35:47 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:35:47 user nova-compute[86931]:     </system>
Nov 16 19:35:47 user nova-compute[86931]:   </sysinfo>
Nov 16 19:35:47 user nova-compute[86931]:   <os>
Nov 16 19:35:47 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:35:47 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:35:47 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:35:47 user nova-compute[86931]:   </os>
Nov 16 19:35:47 user nova-compute[86931]:   <features>
Nov 16 19:35:47 user nova-compute[86931]:     <acpi/>
Nov 16 19:35:47 user nova-compute[86931]:     <apic/>
Nov 16 19:35:47 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:35:47 user nova-compute[86931]:   </features>
Nov 16 19:35:47 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:35:47 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:35:47 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:35:47 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:35:47 user nova-compute[86931]:   </clock>
Nov 16 19:35:47 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:35:47 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:35:47 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:35:47 user nova-compute[86931]:   </cpu>
Nov 16 19:35:47 user nova-compute[86931]:   <devices>
Nov 16 19:35:47 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:35:47 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:35:47 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk"/>
Nov 16 19:35:47 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:35:47 user nova-compute[86931]:     </disk>
Nov 16 19:35:47 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:35:47 user nova-compute[86931]:       <mac address="fa:16:3e:fa:74:b7"/>
Nov 16 19:35:47 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:47 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:35:47 user nova-compute[86931]:       <target dev="tap3a041c70-20"/>
Nov 16 19:35:47 user nova-compute[86931]:     </interface>
Nov 16 19:35:47 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:35:47 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/console.log" append="off"/>
Nov 16 19:35:47 user nova-compute[86931]:     </serial>
Nov 16 19:35:47 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:35:47 user nova-compute[86931]:     <video>
Nov 16 19:35:47 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:47 user nova-compute[86931]:     </video>
Nov 16 19:35:47 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:35:47 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:35:47 user nova-compute[86931]:     </rng>
Nov 16 19:35:47 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:35:47 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:35:47 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:35:47 user nova-compute[86931]:     </memballoon>
Nov 16 19:35:47 user nova-compute[86931]:   </devices>
Nov 16 19:35:47 user nova-compute[86931]: </domain>
Nov 16 19:35:47 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733279661',display_name='tempest-AttachVolumeNegativeTest-server-1733279661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733279661',id=30,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgIDEBTHw8LtzgfJ80dI+yBjTZjttZgNfFbSxYrSj3o+f6O3YJEqtwTnHN+2WXAYjPZZI/nZ1pUTrAl79+0yhQxiztLNsAwzZooGOiMdbvCoGsMzeizs809zf/SryaDkA==',key_name='tempest-keypair-1586161893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-fklqi0r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=ceb5e49c-ad73-48f0-bfe0-b8f18141818d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG os_vif [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd37a9eeb-4da2-5693-906c-6608ada9e9d0', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a041c70-20, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a041c70-20, col_values=(('qos', UUID('8d8a6ff0-1c45-447f-aecd-704e0fc76065')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a041c70-20, col_values=(('external_ids', {'iface-id': '3a041c70-20e3-4bf5-a771-b64105c39036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:74:b7', 'vm-uuid': 'ceb5e49c-ad73-48f0-bfe0-b8f18141818d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:47 user nova-compute[86931]: INFO os_vif [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20')
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:fa:74:b7, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updated VIF entry in instance network info cache for port 3a041c70-20e3-4bf5-a771-b64105c39036. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating instance_info_cache with network_info: [{"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-73e5b96c-4771-4cb2-8160-c450250a7f41 req-209b082d-7184-4cec-bfc8-9b822c0aed73 service nova] Releasing lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:48 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] No waiting events found dispatching network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:49 user nova-compute[86931]: WARNING nova.compute.manager [req-0c28212e-963d-4cdc-8ec3-eb54ac9d5634 req-af01e575-abc4-42f2-9c72-46c0aaa88667 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received unexpected event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 for instance with vm_state building and task_state spawning.
Nov 16 19:35:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:35:51 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Instance spawned successfully.
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] No waiting events found dispatching network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:35:51 user nova-compute[86931]: WARNING nova.compute.manager [req-d547fd93-3cec-46ef-b27c-8b82229ea26c req-26746458-213a-42d4-838a-77b1e19b8db4 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received unexpected event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 for instance with vm_state building and task_state spawning.
Nov 16 19:35:51 user nova-compute[86931]: INFO nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 16 19:35:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:35:51 user nova-compute[86931]: INFO nova.compute.manager [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Took 6.44 seconds to build instance.
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ed299fd2-2bf3-46cd-82e5-838aefba2e8f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.617s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSGcqZIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:35:52 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:52 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:35:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:35:52 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:35:52 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:35:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4cf6c2-4151-4870-9be3-b27a6db3e34e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:35:53 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7634MB free_disk=25.172969818115234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[05223720-bbe6-4377-845b-3c7d2229b438]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d] added
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db4467-7a71-4915-8506-c07bc8a57f68]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d74a55b-8430-4e99-a3da-cb55ac992519]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSGcqZIA {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSGcqZIA" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1277ca-c0c5-4552-9867-484040da72c3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSGcqZIA'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Applying migration context for instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 as it has an incoming, in-progress migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9. Migration status is finished {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 19:35:53 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating resource usage from migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0198b-043a-43c3-bb9c-3ba1384162c4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 64be39ba-20af-46b5-94d7-bec4c08a4775 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bea5c4-c137-4b25-958d-5f21099f472c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c2ac1-6079-4139-897f-83e89df0cf40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260]
Nov 16 19:35:53 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260] successful.
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2fe56d-25c0-4234-aa1e-244faeef0b48]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ba915-7b16-4982-9d99-9e2926c42d11]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:35:53 user nova-compute[86931]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)
Nov 16 19:35:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.777s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9204e-d4b7-4655-a9c2-8166862e153c]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSGcqZIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.285s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:35:53 user nova-compute[86931]: INFO nova.compute.claims [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Claim successful on node user
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.048s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:35:54 user nova-compute[86931]: INFO nova.compute.claims [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Claim successful on node user
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:35:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.policy [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a6c7bcc5a54d819a6cfa7187229c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cf782aee484eb908f5e0d1a348f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.824s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== connect_volume: return (1826ms) {'type': 'block', 'scsi_wwn': '23563366136383565', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563366136383565', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:35:54 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:54 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:35:54 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:35:54 user nova-compute[86931]:   <serial>dd864b25-54c0-447c-b37f-0e78778af42d</serial>
Nov 16 19:35:54 user nova-compute[86931]: </disk>
Nov 16 19:35:54 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:35:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Creating image(s)
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Successfully created port: 5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.220s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No VIF found with MAC fa:16:3e:63:da:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk 1073741824" returned: 0 in 0.197s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e969ef15-51e5-4dc8-8930-ec63d93d4cc0 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.765s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.189s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:35:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Creating image(s)
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Cannot resize image /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Ensure instance console log exists: /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG nova.policy [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a6c7bcc5a54d819a6cfa7187229c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cf782aee484eb908f5e0d1a348f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk 1073741824" returned: 0 in 0.047s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Successfully updated port: 5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-changed-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Refreshing instance network info cache due to event network-changed-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Cannot resize image /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Ensure instance console log exists: /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Successfully created port: fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance network_info: |[{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Refreshing network info cache for port 5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start _get_guest_xml network_info=[{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:35:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941676357',display_name='tempest-ServerRescueNegativeTestJSON-server-1941676357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941676357',id=31,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-z84ou6tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:55Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=433ab086-b0a1-44d9-9840-9696ca7cfca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:35:56 user nova-compute[86931]:   <uuid>433ab086-b0a1-44d9-9840-9696ca7cfca2</uuid>
Nov 16 19:35:56 user nova-compute[86931]:   <name>instance-0000001f</name>
Nov 16 19:35:56 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:35:56 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:35:56 user nova-compute[86931]:   <metadata>
Nov 16 19:35:56 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:35:56 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1941676357</nova:name>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:35:56</nova:creationTime>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:35:56 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:35:56 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:owner>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:35:56 user nova-compute[86931]:       </nova:owner>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:35:56 user nova-compute[86931]:       <nova:ports>
Nov 16 19:35:56 user nova-compute[86931]:         <nova:port uuid="5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e">
Nov 16 19:35:56 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:35:56 user nova-compute[86931]:         </nova:port>
Nov 16 19:35:56 user nova-compute[86931]:       </nova:ports>
Nov 16 19:35:56 user nova-compute[86931]:     </nova:instance>
Nov 16 19:35:56 user nova-compute[86931]:   </metadata>
Nov 16 19:35:56 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:35:56 user nova-compute[86931]:     <system>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="serial">433ab086-b0a1-44d9-9840-9696ca7cfca2</entry>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="uuid">433ab086-b0a1-44d9-9840-9696ca7cfca2</entry>
Nov 16 19:35:56 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:35:56 user nova-compute[86931]:     </system>
Nov 16 19:35:56 user nova-compute[86931]:   </sysinfo>
Nov 16 19:35:56 user nova-compute[86931]:   <os>
Nov 16 19:35:56 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:35:56 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:35:56 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:35:56 user nova-compute[86931]:   </os>
Nov 16 19:35:56 user nova-compute[86931]:   <features>
Nov 16 19:35:56 user nova-compute[86931]:     <acpi/>
Nov 16 19:35:56 user nova-compute[86931]:     <apic/>
Nov 16 19:35:56 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:35:56 user nova-compute[86931]:   </features>
Nov 16 19:35:56 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:35:56 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:35:56 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:35:56 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:35:56 user nova-compute[86931]:   </clock>
Nov 16 19:35:56 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:35:56 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:35:56 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:35:56 user nova-compute[86931]:   </cpu>
Nov 16 19:35:56 user nova-compute[86931]:   <devices>
Nov 16 19:35:56 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:35:56 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:35:56 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk"/>
Nov 16 19:35:56 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:35:56 user nova-compute[86931]:     </disk>
Nov 16 19:35:56 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:35:56 user nova-compute[86931]:       <mac address="fa:16:3e:e5:41:11"/>
Nov 16 19:35:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:56 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:35:56 user nova-compute[86931]:       <target dev="tap5d417b2f-c2"/>
Nov 16 19:35:56 user nova-compute[86931]:     </interface>
Nov 16 19:35:56 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:35:56 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/console.log" append="off"/>
Nov 16 19:35:56 user nova-compute[86931]:     </serial>
Nov 16 19:35:56 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:35:56 user nova-compute[86931]:     <video>
Nov 16 19:35:56 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:56 user nova-compute[86931]:     </video>
Nov 16 19:35:56 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:35:56 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:35:56 user nova-compute[86931]:     </rng>
Nov 16 19:35:56 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:35:56 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:35:56 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:35:56 user nova-compute[86931]:     </memballoon>
Nov 16 19:35:56 user nova-compute[86931]:   </devices>
Nov 16 19:35:56 user nova-compute[86931]: </domain>
Nov 16 19:35:56 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941676357',display_name='tempest-ServerRescueNegativeTestJSON-server-1941676357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941676357',id=31,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-z84ou6tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:55Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=433ab086-b0a1-44d9-9840-9696ca7cfca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG os_vif [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57711017-063e-52dc-81d5-2e44b2f47b6d', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d417b2f-c2, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d417b2f-c2, col_values=(('qos', UUID('6e1d98ea-50e0-4b59-97ed-158dcb219508')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d417b2f-c2, col_values=(('external_ids', {'iface-id': '5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:41:11', 'vm-uuid': '433ab086-b0a1-44d9-9840-9696ca7cfca2'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: INFO os_vif [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2')
Nov 16 19:35:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:e5:41:11, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updated VIF entry in instance network info cache for port 5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5da089f8-d580-4278-9983-10c15ef13934 req-52378e34-d6dc-4c4f-b3bd-30bea975fbe6 service nova] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Successfully updated port: fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance network_info: |[{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start _get_guest_xml network_info=[{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:35:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1907946945',display_name='tempest-ServerRescueNegativeTestJSON-server-1907946945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1907946945',id=32,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-0a657pvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:56Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=740a055e-78a9-4941-88f6-7d3ba9986c36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.objects.instance [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:35:57 user nova-compute[86931]:   <uuid>740a055e-78a9-4941-88f6-7d3ba9986c36</uuid>
Nov 16 19:35:57 user nova-compute[86931]:   <name>instance-00000020</name>
Nov 16 19:35:57 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:35:57 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:35:57 user nova-compute[86931]:   <metadata>
Nov 16 19:35:57 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:35:57 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1907946945</nova:name>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:35:57</nova:creationTime>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:35:57 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:35:57 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:owner>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:35:57 user nova-compute[86931]:       </nova:owner>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:35:57 user nova-compute[86931]:       <nova:ports>
Nov 16 19:35:57 user nova-compute[86931]:         <nova:port uuid="fdd6a513-8eb1-410c-8b10-f10971521a91">
Nov 16 19:35:57 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:35:57 user nova-compute[86931]:         </nova:port>
Nov 16 19:35:57 user nova-compute[86931]:       </nova:ports>
Nov 16 19:35:57 user nova-compute[86931]:     </nova:instance>
Nov 16 19:35:57 user nova-compute[86931]:   </metadata>
Nov 16 19:35:57 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:35:57 user nova-compute[86931]:     <system>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="serial">740a055e-78a9-4941-88f6-7d3ba9986c36</entry>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="uuid">740a055e-78a9-4941-88f6-7d3ba9986c36</entry>
Nov 16 19:35:57 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:35:57 user nova-compute[86931]:     </system>
Nov 16 19:35:57 user nova-compute[86931]:   </sysinfo>
Nov 16 19:35:57 user nova-compute[86931]:   <os>
Nov 16 19:35:57 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:35:57 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:35:57 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:35:57 user nova-compute[86931]:   </os>
Nov 16 19:35:57 user nova-compute[86931]:   <features>
Nov 16 19:35:57 user nova-compute[86931]:     <acpi/>
Nov 16 19:35:57 user nova-compute[86931]:     <apic/>
Nov 16 19:35:57 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:35:57 user nova-compute[86931]:   </features>
Nov 16 19:35:57 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:35:57 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:35:57 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:35:57 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:35:57 user nova-compute[86931]:   </clock>
Nov 16 19:35:57 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:35:57 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:35:57 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:35:57 user nova-compute[86931]:   </cpu>
Nov 16 19:35:57 user nova-compute[86931]:   <devices>
Nov 16 19:35:57 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:35:57 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:35:57 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk"/>
Nov 16 19:35:57 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:35:57 user nova-compute[86931]:     </disk>
Nov 16 19:35:57 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:35:57 user nova-compute[86931]:       <mac address="fa:16:3e:87:0e:0f"/>
Nov 16 19:35:57 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:57 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:35:57 user nova-compute[86931]:       <target dev="tapfdd6a513-8e"/>
Nov 16 19:35:57 user nova-compute[86931]:     </interface>
Nov 16 19:35:57 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:35:57 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/console.log" append="off"/>
Nov 16 19:35:57 user nova-compute[86931]:     </serial>
Nov 16 19:35:57 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:35:57 user nova-compute[86931]:     <video>
Nov 16 19:35:57 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:35:57 user nova-compute[86931]:     </video>
Nov 16 19:35:57 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:35:57 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:35:57 user nova-compute[86931]:     </rng>
Nov 16 19:35:57 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:35:57 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:35:57 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:35:57 user nova-compute[86931]:     </memballoon>
Nov 16 19:35:57 user nova-compute[86931]:   </devices>
Nov 16 19:35:57 user nova-compute[86931]: </domain>
Nov 16 19:35:57 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1907946945',display_name='tempest-ServerRescueNegativeTestJSON-server-1907946945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1907946945',id=32,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-0a657pvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:35:56Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=740a055e-78a9-4941-88f6-7d3ba9986c36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG os_vif [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1859c19-7f34-5320-a02f-06110a5e2fe7', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdd6a513-8e, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdd6a513-8e, col_values=(('qos', UUID('4df056f9-c60c-48b2-a2a1-63bdc9546ab9')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdd6a513-8e, col_values=(('external_ids', {'iface-id': 'fdd6a513-8eb1-410c-8b10-f10971521a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:0e:0f', 'vm-uuid': '740a055e-78a9-4941-88f6-7d3ba9986c36'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: INFO os_vif [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e')
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:87:0e:0f, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:35:58 user nova-compute[86931]: INFO nova.compute.manager [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Detaching volume dd864b25-54c0-447c-b37f-0e78778af42d
Nov 16 19:35:58 user nova-compute[86931]: INFO nova.virt.block_device [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attempting to driver detach volume dd864b25-54c0-447c-b37f-0e78778af42d from mountpoint /dev/vdb
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Attempting to detach device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:35:58 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:58 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:35:58 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:35:58 user nova-compute[86931]:   <serial>dd864b25-54c0-447c-b37f-0e78778af42d</serial>
Nov 16 19:35:58 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:35:58 user nova-compute[86931]: </disk>
Nov 16 19:35:58 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:35:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config.
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:35:58 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:35:58 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:35:58 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:35:58 user nova-compute[86931]:   <serial>dd864b25-54c0-447c-b37f-0e78778af42d</serial>
Nov 16 19:35:58 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:35:58 user nova-compute[86931]: </disk>
Nov 16 19:35:58 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-changed-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Refreshing instance network info cache due to event network-changed-fdd6a513-8eb1-410c-8b10-f10971521a91. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Refreshing network info cache for port fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updated VIF entry in instance network info cache for port fdd6a513-8eb1-410c-8b10-f10971521a91. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:35:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-722147f6-58d1-4ef6-84ab-74b2a960bf20 req-73ff0e27-1eaa-4c4f-b98c-188174fb0e1d service nova] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:35:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:00 user nova-compute[86931]: WARNING nova.compute.manager [req-05104c05-51d5-4f99-af37-814018e2641b req-86076ae2-fdc6-4e2e-9963-63ce4ff7b1f0 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state building and task_state spawning.
Nov 16 19:36:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:00 user nova-compute[86931]: WARNING nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state building and task_state spawning.
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:00 user nova-compute[86931]: WARNING nova.compute.manager [req-0e0cb6ff-3363-4af8-a1aa-babeabcd037c req-ba92a1e4-3df2-4afc-a5c7-b19898785b37 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state building and task_state spawning.
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:36:01 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance spawned successfully.
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:01 user nova-compute[86931]: INFO nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Took 7.21 seconds to spawn the instance on the hypervisor.
Nov 16 19:36:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:36:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:02 user nova-compute[86931]: INFO nova.compute.manager [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Took 8.39 seconds to build instance.
Nov 16 19:36:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-dcadcf8d-507f-4a33-968a-18c8cec447ed tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.514s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:02 user nova-compute[86931]: WARNING nova.compute.manager [req-b5972a95-3d2e-4879-b3a4-02f08dc4da19 req-f63935ae-9196-41d1-8f0c-a008661a2a04 service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state building and task_state spawning.
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:36:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance spawned successfully.
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:36:02 user nova-compute[86931]: INFO nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 16 19:36:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:36:02 user nova-compute[86931]: INFO nova.compute.manager [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Took 8.20 seconds to build instance.
Nov 16 19:36:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-362638a7-cf09-44d7-aeb6-8c04034e63db tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.304s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing instance network info cache due to event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updated VIF entry in instance network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7516e3fa-eccf-48c6-9dcf-a3e7c0a0621d req-faf4b7ee-a4c7-4675-bf43-de30f0014eea service nova] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:13 user nova-compute[86931]: INFO nova.compute.manager [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Shelving
Nov 16 19:36:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:13 user nova-compute[86931]: WARNING nova.compute.manager [req-e96b9b52-d81c-4643-946d-c83a8dfd684d req-8bd2072a-a07a-4b22-beb8-2a2bcecfe964 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state active and task_state shelving.
Nov 16 19:36:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance destroyed successfully.
Nov 16 19:36:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Beginning cold snapshot process
Nov 16 19:36:14 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:36:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk /opt/stack/data/nova/instances/snapshots/tmpvtl7ao94/9d3a0a6000384d54a1606ffe299f1bfc {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk /opt/stack/data/nova/instances/snapshots/tmpvtl7ao94/9d3a0a6000384d54a1606ffe299f1bfc" returned: 0 in 0.921s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Snapshot extracted, beginning image upload
Nov 16 19:36:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:15 user nova-compute[86931]: WARNING nova.compute.manager [req-ac6f4d0a-50a6-48d6-8c23-14cad06226c8 req-d2986800-09c1-4ea6-847b-f0a750f5021e service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 19:36:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Snapshot image upload complete
Nov 16 19:36:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:36:17 user nova-compute[86931]: INFO nova.compute.manager [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Shelve offloading
Nov 16 19:36:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance destroyed successfully.
Nov 16 19:36:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:36:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:17 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance destroyed successfully.
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'resources' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN62Tm2hkJO31mI8sKVjFAW7p+2HWIdVslzjEy3GpvN6Tv7YWvSCXbf5V+LnWm5SBYycrbysIWt/FO8SusP23pjycJCubr71x/+WOIsrEgWT/LQ+W1Du4Z7Bwzy0lNl9aw==',key_name='tempest-keypair-2010505057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:36:17.887793',shelved_host='user',shelved_image_id='4feb64ee-7b94-4b3b-8ae4-e35218ba8137'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:36:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG os_vif [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb06d9c28-33, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing instance network info cache due to event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.network.neutron [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=779954f3-d225-478a-98de-300a0f313ea2) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:18 user nova-compute[86931]: INFO os_vif [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33')
Nov 16 19:36:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Deleting instance files /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0_del
Nov 16 19:36:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Deletion of /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0_del complete
Nov 16 19:36:18 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Deleted allocations for instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0
Nov 16 19:36:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.objects.base [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0> lazy-loaded attributes: resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:36:19 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b is timed out.
Nov 16 19:36:19 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config.
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSGcqZIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:36:19 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e165b73-88f9-4708-9eee-7dd887e84dfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:36:19 user nova-compute[86931]: No targets found.
Nov 16 19:36:19 user nova-compute[86931]: iSNS:
Nov 16 19:36:19 user nova-compute[86931]: No targets found.
Nov 16 19:36:19 user nova-compute[86931]: STATIC:
Nov 16 19:36:19 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d
Nov 16 19:36:19 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:19 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:19 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:36:19 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:19 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:19 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:36:19 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:19 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:19 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:36:19 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:19 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:19 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:36:19 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:19 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:19 user nova-compute[86931]: FIRMWARE:
Nov 16 19:36:19 user nova-compute[86931]: No targets found.
Nov 16 19:36:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:36:19 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:36:19 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[62613568-3643-40e4-8f04-bf6a6d55eb7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updated VIF entry in instance network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb06d9c28-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-79e46414-218b-493b-ab23-78324503a98a req-d53ab8fa-1bb2-4bd8-b20d-26dde988098b service nova] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173482e-7b44-4bbc-915c-96e9fe985411]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)
Nov 16 19:36:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:19 user nova-compute[86931]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d (non-flash)
Nov 16 19:36:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c285a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac90e6-4424-479f-b698-11cc3421bafc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b26afd-41aa-4d2f-9c0a-9f016bc6e86c]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb942b56-1030-4758-9126-f9a64c8e0623]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a171265-e207-443e-8f69-c7ea30de1b18]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0bd5b0-df63-49ed-a3dd-8ad8b995a0e7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c1922585-b2ff-452c-9d98-ff3c5b187746 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.010s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf0f861-8666-4a30-a0df-17632f7fc38c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260]
Nov 16 19:36:19 user nova-compute[86931]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d, portal: 172.16.0.220,3260] successful.
Nov 16 19:36:19 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd864b25-54c0-447c-b37f-0e78778af42d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509fb8c-44e9-41ff-b691-90e35cb963d4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== disconnect_volume: return (336ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:36:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:20 user nova-compute[86931]: DEBUG nova.objects.instance [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-38f13de0-66da-44f3-8df7-cf03013ec06e tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.254s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-changed-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Refreshing instance network info cache due to event network-changed-12e878fc-a692-4228-976a-17109e124df5. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] Acquiring lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] Acquired lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Refreshing network info cache for port 12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updated VIF entry in instance network info cache for port 12e878fc-a692-4228-976a-17109e124df5. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updating instance_info_cache with network_info: [{"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70dcebf7-9791-4f2c-a9ab-4bbb2e5f3eaf req-02e5944a-8b6d-4d3d-a900-565f20269f27 service nova] Releasing lock "refresh_cache-64be39ba-20af-46b5-94d7-bec4c08a4775" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:21 user nova-compute[86931]: INFO nova.compute.manager [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Terminating instance
Nov 16 19:36:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-unplugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] No waiting events found dispatching network-vif-unplugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e15b784d-cab5-409d-9123-0189819735a0 req-45dd10f4-789c-485a-9693-2af5be0f1ee6 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-unplugged-12e878fc-a692-4228-976a-17109e124df5 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Instance destroyed successfully.
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid 64be39ba-20af-46b5-94d7-bec4c08a4775 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558632597',display_name='tempest-TestVolumeBootPattern-server-558632597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558632597',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-suylwqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:34:41Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=64be39ba-20af-46b5-94d7-bec4c08a4775,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "12e878fc-a692-4228-976a-17109e124df5", "address": "fa:16:3e:b4:75:8a", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12e878fc-a6", "ovs_interfaceid": "12e878fc-a692-4228-976a-17109e124df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_vif [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12e878fc-a6, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7f4222b-351b-4166-84dd-dd320d85a891) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:22 user nova-compute[86931]: INFO os_vif [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:8a,bridge_name='br-int',has_traffic_filtering=True,id=12e878fc-a692-4228-976a-17109e124df5,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12e878fc-a6')
Nov 16 19:36:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:36:22 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd0ed9-9c8e-4bb1-be43-521273f7d198]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:36:22 user nova-compute[86931]: No targets found.
Nov 16 19:36:22 user nova-compute[86931]: iSNS:
Nov 16 19:36:22 user nova-compute[86931]: No targets found.
Nov 16 19:36:22 user nova-compute[86931]: STATIC:
Nov 16 19:36:22 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:36:22 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:22 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:22 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:36:22 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:22 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:22 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:36:22 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:22 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:22 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:36:22 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:36:22 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:36:22 user nova-compute[86931]: FIRMWARE:
Nov 16 19:36:22 user nova-compute[86931]: No targets found.
Nov 16 19:36:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:36:22 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:36:22 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323e24f-2979-4533-8ec4-7ad4100667a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb5260-708a-4e4e-be6e-b51c36b90fe2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c4cef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409'): ({'sdg'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sdg {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6661f-dc3c-46d8-b218-645dcf85ea3f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db743372-ab25-468e-b13c-27a2e1d8305b]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sdg {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7479de9-cb53-43ba-900e-f2fe42c9c3f4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b573ea4e-605e-42b6-80e6-b3e23dd3f0bd]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26430383964303866', '/dev/disk/by-id/scsi-1SCST_BIOf5d41e44-d089d08fd4d54327', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5d41e44') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f326794-e9c1-4915-bf29-4ca37218c754]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522c91f-c741-43d0-8bc2-8445a2d0d977]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b89e0-700c-4f76-b0f1-5a93b96b6984]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]
Nov 16 19:36:23 user nova-compute[86931]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.
Nov 16 19:36:23 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce378f-ddd4-4def-9367-8315ffa5db10]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (339ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:36:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Deleting instance files /opt/stack/data/nova/instances/64be39ba-20af-46b5-94d7-bec4c08a4775_del
Nov 16 19:36:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Deletion of /opt/stack/data/nova/instances/64be39ba-20af-46b5-94d7-bec4c08a4775_del complete
Nov 16 19:36:23 user nova-compute[86931]: INFO nova.compute.manager [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 16 19:36:23 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:36:23 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:23 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Took 0.75 seconds to deallocate network for instance.
Nov 16 19:36:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] Acquiring lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] No waiting events found dispatching network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:36:24 user nova-compute[86931]: WARNING nova.compute.manager [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received unexpected event network-vif-plugged-12e878fc-a692-4228-976a-17109e124df5 for instance with vm_state active and task_state deleting.
Nov 16 19:36:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-964a7f48-fe4a-4f67-9432-4bfcfea18bc4 req-290d6799-942f-4861-8679-059708809b26 service nova] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Received event network-vif-deleted-12e878fc-a692-4228-976a-17109e124df5 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:36:24 user nova-compute[86931]: INFO nova.compute.manager [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 64be39ba-20af-46b5-94d7-bec4c08a4775] Took 0.79 seconds to detach 1 volumes for instance.
Nov 16 19:36:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:25 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:36:25 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:36:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:25 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance 64be39ba-20af-46b5-94d7-bec4c08a4775
Nov 16 19:36:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-32664679-27e2-466d-85a2-eaebeb844de3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "64be39ba-20af-46b5-94d7-bec4c08a4775" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:44 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:47 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:36:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:36:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [{"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-afe35609-1004-4958-9893-d82894b6f297" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: afe35609-1004-4958-9893-d82894b6f297] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:36:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:50 user nova-compute[86931]: INFO nova.compute.manager [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attaching volume 50a66a7d-b047-487b-86f8-355d64c0c852 to /dev/vdb
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.utils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0859b501-7abd-4be0-98ef-d6e4ab140272]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[615809f5-6c37-4cb7-8821-781a55a17cf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[90962c70-f5d7-4690-8e1d-95bd0df8a2c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ad081e-98ba-4ba0-8f8d-95267cfd8694]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:36:50 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7889bed-bb1f-4c1c-820e-6eec5b68a3d0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG os_brick.utils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating existing volume attachment record: 66eead07-9bc9-4e71-8568-e7c4c23764f3 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:36:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:36:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:36:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=25.054473876953125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Applying migration context for instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 as it has an incoming, in-progress migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9. Migration status is finished {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 19:36:54 user nova-compute[86931]: INFO nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating resource usage from migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Going to confirm migration 2 {{(pid=86931) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquired lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:36:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'info_cache' on Instance uuid 105dd9f1-9f20-4f05-8dd4-ad360886dc09 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.network.neutron [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [{"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Releasing lock "refresh_cache-105dd9f1-9f20-4f05-8dd4-ad360886dc09" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'migration_context' on Instance uuid 105dd9f1-9f20-4f05-8dd4-ad360886dc09 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.objects.base [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Object Instance<105dd9f1-9f20-4f05-8dd4-ad360886dc09> lazy-loaded attributes: info_cache,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLnbVqFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:36:55 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:36:55 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:36:55 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8521acd0-f23b-4bda-ae42-b31c7d0441dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:36:55 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b156c109-8e8d-49e3-8d03-761b32989d59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852] added
Nov 16 19:36:55 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.380s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb08bef-335d-4e32-a20b-7597f617a0c1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c253f11-a82e-48e8-8f17-f279e5e3cc94]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLnbVqFN {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLnbVqFN" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9cf49a-cef2-4d48-9cb0-6aae52f9901e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLnbVqFN'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f75222-6c84-4142-b890-ddcc1f981989]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afa725-e93d-4bba-8845-8c5f034b17c5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Deleted allocation for migration 3521d862-6fb2-44c3-b4e3-4f14a43ecca9
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be766d1-98f7-4f98-a403-f8d678694a95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260]
Nov 16 19:36:56 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260] successful.
Nov 16 19:36:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e81cdb-3c44-4536-a237-b09dd2fad5ea]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[867124be-8d09-438c-9b5d-376aa9f01d9e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:36:56 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d49355bb-f53b-4fec-8900-01d099de5deb tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.515s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b106f-be40-43a6-97fd-c3f42423d487]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLnbVqFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:36:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23435303364326665', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435303364326665', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:36:57 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:36:57 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:36:57 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:36:57 user nova-compute[86931]:   <serial>50a66a7d-b047-487b-86f8-355d64c0c852</serial>
Nov 16 19:36:57 user nova-compute[86931]: </disk>
Nov 16 19:36:57 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] No VIF found with MAC fa:16:3e:63:da:94, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:36:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b95b239-426f-4be9-9a40-83e61cd6958c tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.499s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:36:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:36:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:36:59 user nova-compute[86931]: INFO nova.compute.manager [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Detaching volume 50a66a7d-b047-487b-86f8-355d64c0c852
Nov 16 19:36:59 user nova-compute[86931]: INFO nova.virt.block_device [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Attempting to driver detach volume 50a66a7d-b047-487b-86f8-355d64c0c852 from mountpoint /dev/vdb
Nov 16 19:36:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Attempting to detach device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:36:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:36:59 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:36:59 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:36:59 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:36:59 user nova-compute[86931]:   <serial>50a66a7d-b047-487b-86f8-355d64c0c852</serial>
Nov 16 19:36:59 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:36:59 user nova-compute[86931]: </disk>
Nov 16 19:36:59 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:37:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the persistent domain config.
Nov 16 19:37:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:37:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:37:00 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:37:00 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:37:00 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:37:00 user nova-compute[86931]:   <serial>50a66a7d-b047-487b-86f8-355d64c0c852</serial>
Nov 16 19:37:00 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:37:00 user nova-compute[86931]: </disk>
Nov 16 19:37:00 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:37:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:37:01 user nova-compute[86931]: INFO nova.compute.manager [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Unrescuing
Nov 16 19:37:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquired lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG nova.network.neutron [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [{"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Releasing lock "refresh_cache-3f799e54-3a33-4e78-b043-dce4e012701f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG nova.objects.instance [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'flavor' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:02 user nova-compute[86931]: WARNING nova.compute.manager [req-d84db28b-f968-4d50-9fd4-2b5050e5f7f0 req-ab1e7394-d586-41a9-b4ce-c745642b4d8e service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance destroyed successfully.
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:04 user nova-compute[86931]: WARNING nova.compute.manager [req-582ae465-ff29-49e2-9110-00f23e663fb8 req-7724f001-4ac9-496a-9bb0-04476691164c service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:37:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-eaf9b7d3-a5ed-4a14-a47a-04baac552e84 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:06 user nova-compute[86931]: WARNING nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state None.
Nov 16 19:37:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:06 user nova-compute[86931]: WARNING nova.compute.manager [req-a82d425a-c0f4-4064-a720-582785e0ca75 req-31cb1027-0467-42cc-9421-d6da7b404f58 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state None.
Nov 16 19:37:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:37:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:37:14 user nova-compute[86931]: INFO nova.compute.claims [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Claim successful on node user
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:37:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.policy [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:37:14 user nova-compute[86931]: INFO nova.virt.block_device [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Booting with volume d7cb7c5a-08ec-46f1-8e73-ae067625a409 at /dev/vda
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.utils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570a3d7-0739-4f32-941e-d12aba3a5ab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06626180-6ac1-4b79-a86b-89759058db8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85bf470-25e4-4aca-9d94-58b31767cc1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08fdf8-ef93-47dc-83fa-305b48ce5646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:37:14 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:37:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a19086-1d45-4e69-8e19-416ea0a1fd86]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG os_brick.utils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:37:14 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating existing volume attachment record: 4646a25a-3b07-44d6-a0ba-f190150eddea {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Successfully created port: 03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Successfully updated port: 03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing instance network info cache due to event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:37:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] Acquiring lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.network.neutron [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating instance_info_cache with network_info: [{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Instance network_info: |[{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] Acquired lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updated VIF entry in instance network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating instance_info_cache with network_info: [{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4b7bef8b-003d-4174-8548-bd2afb348cb3 req-048125bf-be99-4628-9201-4fdc17da95d5 service nova] Releasing lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:37:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Creating image(s)
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Ensure instance console log exists: /opt/stack/data/nova/instances/a29e474f-1d9d-49e8-bccb-b252d7168ab1/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Start _get_guest_xml network_info=[{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '4646a25a-3b07-44d6-a0ba-f190150eddea', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a29e474f-1d9d-49e8-bccb-b252d7168ab1', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7cb7c5a-08ec-46f1-8e73-ae067625a409', 'serial': 'd7cb7c5a-08ec-46f1-8e73-ae067625a409'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:37:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:37:20 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:37:20 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:37:20 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d926e7f8-c055-4f0a-99e2-c7d4a66539f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:37:20 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27bd3b8-41fd-46f2-b8d1-42db0660fd52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409] added
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb12b8-a41e-4cc0-85c6-733632b396c7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c611c7-87c6-409b-82d5-11b7f1bd10e9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IODwXREl {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IODwXREl" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e74a7b-5cee-49f2-9b83-f05ad32bf582]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b is timed out.
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IODwXREl'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully detached device vdb from instance a6231ab3-ae23-4b87-926c-86fd9e0a357b from the live domain config.
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLnbVqFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:37:20 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[558aec46-e67b-4b52-a8b3-4d3757f2e65a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed898b27-4c8b-4e6b-85c4-0fbf8b1baec4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e668db5-9f67-4ca8-8bda-d4664e48d13a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]
Nov 16 19:37:20 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aedbb59-cb0e-4761-9399-12775e76fed3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b4559-0ab9-4d86-9587-823f7a6c4c5f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:20 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24bd301-73af-4bf6-92e4-56024df28108]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:37:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26430383964303866', 'path': '/dev/sde'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430383964303866', 'path': '/dev/sde'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.199s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585d491-b5cf-4e3a-8646-a5d2110fdc9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:37:21 user nova-compute[86931]: No targets found.
Nov 16 19:37:21 user nova-compute[86931]: iSNS:
Nov 16 19:37:21 user nova-compute[86931]: No targets found.
Nov 16 19:37:21 user nova-compute[86931]: STATIC:
Nov 16 19:37:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:37:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:37:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:37:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:37:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:37:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:37:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852
Nov 16 19:37:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:37:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:37:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:37:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:37:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:37:21 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:37:21 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:37:21 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:37:21 user nova-compute[86931]: FIRMWARE:
Nov 16 19:37:21 user nova-compute[86931]: No targets found.
Nov 16 19:37:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:37:21 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:37:21 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3507f3de-55e0-46f3-95ab-3b60ff5c516f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-781407118',display_name='tempest-TestVolumeBootPattern-server-781407118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-781407118',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-5mjt2fly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:15Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=a29e474f-1d9d-49e8-bccb-b252d7168ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.objects.instance [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid a29e474f-1d9d-49e8-bccb-b252d7168ab1 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3bf82-9047-4729-ab77-4831d0c5b617]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:37:21 user nova-compute[86931]:   <uuid>a29e474f-1d9d-49e8-bccb-b252d7168ab1</uuid>
Nov 16 19:37:21 user nova-compute[86931]:   <name>instance-00000021</name>
Nov 16 19:37:21 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:37:21 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:37:21 user nova-compute[86931]:   <metadata>
Nov 16 19:37:21 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:37:21 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:37:21 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-server-781407118</nova:name>
Nov 16 19:37:21 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:37:20</nova:creationTime>
Nov 16 19:37:21 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:37:21 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:37:21 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:37:21 user nova-compute[86931]:       <nova:owner>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:37:21 user nova-compute[86931]:       </nova:owner>
Nov 16 19:37:21 user nova-compute[86931]:       <nova:ports>
Nov 16 19:37:21 user nova-compute[86931]:         <nova:port uuid="03a37e09-338e-4907-9ed4-cf79480f3807">
Nov 16 19:37:21 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:37:21 user nova-compute[86931]:         </nova:port>
Nov 16 19:37:21 user nova-compute[86931]:       </nova:ports>
Nov 16 19:37:21 user nova-compute[86931]:     </nova:instance>
Nov 16 19:37:21 user nova-compute[86931]:   </metadata>
Nov 16 19:37:21 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:37:21 user nova-compute[86931]:     <system>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="serial">a29e474f-1d9d-49e8-bccb-b252d7168ab1</entry>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="uuid">a29e474f-1d9d-49e8-bccb-b252d7168ab1</entry>
Nov 16 19:37:21 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:37:21 user nova-compute[86931]:     </system>
Nov 16 19:37:21 user nova-compute[86931]:   </sysinfo>
Nov 16 19:37:21 user nova-compute[86931]:   <os>
Nov 16 19:37:21 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:37:21 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:37:21 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:37:21 user nova-compute[86931]:   </os>
Nov 16 19:37:21 user nova-compute[86931]:   <features>
Nov 16 19:37:21 user nova-compute[86931]:     <acpi/>
Nov 16 19:37:21 user nova-compute[86931]:     <apic/>
Nov 16 19:37:21 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:37:21 user nova-compute[86931]:   </features>
Nov 16 19:37:21 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:37:21 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:37:21 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:37:21 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:37:21 user nova-compute[86931]:   </clock>
Nov 16 19:37:21 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:37:21 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:37:21 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:37:21 user nova-compute[86931]:   </cpu>
Nov 16 19:37:21 user nova-compute[86931]:   <devices>
Nov 16 19:37:21 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:37:21 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:37:21 user nova-compute[86931]:       <source dev="/dev/sde"/>
Nov 16 19:37:21 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:37:21 user nova-compute[86931]:       <serial>d7cb7c5a-08ec-46f1-8e73-ae067625a409</serial>
Nov 16 19:37:21 user nova-compute[86931]:     </disk>
Nov 16 19:37:21 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:37:21 user nova-compute[86931]:       <mac address="fa:16:3e:29:5c:da"/>
Nov 16 19:37:21 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:21 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:37:21 user nova-compute[86931]:       <target dev="tap03a37e09-33"/>
Nov 16 19:37:21 user nova-compute[86931]:     </interface>
Nov 16 19:37:21 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:37:21 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/a29e474f-1d9d-49e8-bccb-b252d7168ab1/console.log" append="off"/>
Nov 16 19:37:21 user nova-compute[86931]:     </serial>
Nov 16 19:37:21 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:37:21 user nova-compute[86931]:     <video>
Nov 16 19:37:21 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:21 user nova-compute[86931]:     </video>
Nov 16 19:37:21 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:37:21 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:37:21 user nova-compute[86931]:     </rng>
Nov 16 19:37:21 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:37:21 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:37:21 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:37:21 user nova-compute[86931]:     </memballoon>
Nov 16 19:37:21 user nova-compute[86931]:   </devices>
Nov 16 19:37:21 user nova-compute[86931]: </domain>
Nov 16 19:37:21 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-781407118',display_name='tempest-TestVolumeBootPattern-server-781407118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-781407118',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-5mjt2fly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:15Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=a29e474f-1d9d-49e8-bccb-b252d7168ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_vif [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb28c015-5fba-58b1-99d1-158998d6cece', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d2b6b-c03d-43eb-9d4f-d25dbed39d58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03a37e09-33, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03a37e09-33, col_values=(('qos', UUID('c648e254-b05d-4ed1-9aba-d3303af1ffdb')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03a37e09-33, col_values=(('external_ids', {'iface-id': '03a37e09-338e-4907-9ed4-cf79480f3807', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:5c:da', 'vm-uuid': 'a29e474f-1d9d-49e8-bccb-b252d7168ab1'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:21 user nova-compute[86931]: INFO os_vif [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33')
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb586085-426b-49ee-9a5a-8008e4e162fa]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[214dd283-5a95-4a1d-b9b2-aa8751197851]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:29:5c:da, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f70b49d-a5bc-42c9-91aa-2a62e4ca96dd]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b649276e-2a0f-4398-a80e-e6d107d51b42]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff6822-c33f-4af7-9578-fa3297497ea2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260]
Nov 16 19:37:22 user nova-compute[86931]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852, portal: 172.16.0.220,3260] successful.
Nov 16 19:37:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a66a7d-b047-487b-86f8-355d64c0c852 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8bff52-5baf-4c43-8590-f99b6ff8dc3c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] <== disconnect_volume: return (1531ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:37:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'flavor' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e5b0ad5c-9c88-4e89-9df7-ed2da51968f3 tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.141s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] No waiting events found dispatching network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:23 user nova-compute[86931]: WARNING nova.compute.manager [req-af455551-89c9-408e-b66c-f2ea6e973f67 req-af8ee016-f637-44b9-bebc-f2726d298d68 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received unexpected event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 for instance with vm_state building and task_state spawning.
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:37:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Instance spawned successfully.
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] No waiting events found dispatching network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:25 user nova-compute[86931]: WARNING nova.compute.manager [req-26d97e49-150c-4330-baed-a53a29f13b74 req-21151ac3-5671-4786-b6f5-32ded600ad6e service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received unexpected event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 for instance with vm_state building and task_state spawning.
Nov 16 19:37:25 user nova-compute[86931]: INFO nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 16 19:37:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:37:25 user nova-compute[86931]: INFO nova.compute.manager [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Took 11.79 seconds to build instance.
Nov 16 19:37:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-775bc6d8-89a9-4713-a993-f6dc419864c8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.990s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-changed-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Refreshing instance network info cache due to event network-changed-3a041c70-20e3-4bf5-a771-b64105c39036. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] Acquiring lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] Acquired lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG nova.network.neutron [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Refreshing network info cache for port 3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:37:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updated VIF entry in instance network info cache for port 3a041c70-20e3-4bf5-a771-b64105c39036. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:37:37 user nova-compute[86931]: DEBUG nova.network.neutron [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating instance_info_cache with network_info: [{"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0768c594-1e5b-4bb9-a435-4dd5b48a8390 req-6c297653-c542-463f-ab73-2442dc7382ee service nova] Releasing lock "refresh_cache-ceb5e49c-ad73-48f0-bfe0-b8f18141818d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:39 user nova-compute[86931]: INFO nova.compute.manager [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Attaching volume 3109c511-d67f-4091-8dd7-2a1203f2c648 to /dev/vdb
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.utils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11a143-152f-4410-9933-6a2e36c35e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310ca79-6d29-4546-9c99-aaf162c9a3b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c64f70-cc04-426a-b19f-31ab17716620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3041d6-394c-4bd5-b179-65c5ad55551b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:37:39 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:37:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[921914d8-16df-4eea-b276-5173b2171660]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG os_brick.utils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:37:39 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating existing volume attachment record: 3c4c23f9-dfcd-4422-83bc-c76caf484d39 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:37:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:43 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:44 user nova-compute[86931]: INFO nova.compute.manager [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Rescuing
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shiExVvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:37:44 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:37:44 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:37:44 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cee5c8-104a-4315-95f6-2b220b1f7fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:37:44 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[91619573-ac94-44d8-9fe9-64d6aeb590ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648] added
Nov 16 19:37:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG nova.network.neutron [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988d34e-5ba3-4f3d-89a3-d020cc4f9e5e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb8d4dd-3cae-493a-ad0e-4777c1902baa]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shiExVvI {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v shiExVvI" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[066ea133-f40a-4b06-951b-e27fe792f53e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'shiExVvI'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d708a-103a-4750-a4a3-1352debaee71]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4b362-1ed3-456b-aa7c-565d92627eaa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aec133c-b329-4522-8473-74a0e976f106]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260]
Nov 16 19:37:45 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260] successful.
Nov 16 19:37:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc5b9c-3709-4b48-9ef6-9f95121c85e3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072baa6-89ed-4165-a63a-3a748a99deff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:37:45 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[73abba2e-96d8-4522-82af-5a626e713759]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shiExVvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:45 user nova-compute[86931]: WARNING nova.compute.manager [req-30512da9-0417-43bf-bf89-3270a0d20a1d req-8d8db110-6a15-4efc-a37e-78400b4d796a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state active and task_state rescuing.
Nov 16 19:37:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance destroyed successfully.
Nov 16 19:37:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Attempting rescue
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:37:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Creating image(s)
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue" returned: 0 in 0.052s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'migration_context' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.base [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<740a055e-78a9-4941-88f6-7d3ba9986c36> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start _get_guest_xml network_info=[{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:87:0e:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.base [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<740a055e-78a9-4941-88f6-7d3ba9986c36> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'numa_topology' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.base [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<740a055e-78a9-4941-88f6-7d3ba9986c36> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:37:45 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:45 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:37:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.objects.base [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<740a055e-78a9-4941-88f6-7d3ba9986c36> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1907946945',display_name='tempest-ServerRescueNegativeTestJSON-server-1907946945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1907946945',id=32,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-0a657pvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:36:03Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=740a055e-78a9-4941-88f6-7d3ba9986c36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:87:0e:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:87:0e:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.objects.instance [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.objects.base [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<740a055e-78a9-4941-88f6-7d3ba9986c36> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:37:46 user nova-compute[86931]:   <uuid>740a055e-78a9-4941-88f6-7d3ba9986c36</uuid>
Nov 16 19:37:46 user nova-compute[86931]:   <name>instance-00000020</name>
Nov 16 19:37:46 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:37:46 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:37:46 user nova-compute[86931]:   <metadata>
Nov 16 19:37:46 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:37:46 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1907946945</nova:name>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:37:45</nova:creationTime>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:37:46 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:37:46 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:owner>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:37:46 user nova-compute[86931]:       </nova:owner>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:37:46 user nova-compute[86931]:       <nova:ports>
Nov 16 19:37:46 user nova-compute[86931]:         <nova:port uuid="fdd6a513-8eb1-410c-8b10-f10971521a91">
Nov 16 19:37:46 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:37:46 user nova-compute[86931]:         </nova:port>
Nov 16 19:37:46 user nova-compute[86931]:       </nova:ports>
Nov 16 19:37:46 user nova-compute[86931]:     </nova:instance>
Nov 16 19:37:46 user nova-compute[86931]:   </metadata>
Nov 16 19:37:46 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:37:46 user nova-compute[86931]:     <system>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="serial">740a055e-78a9-4941-88f6-7d3ba9986c36</entry>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="uuid">740a055e-78a9-4941-88f6-7d3ba9986c36</entry>
Nov 16 19:37:46 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:37:46 user nova-compute[86931]:     </system>
Nov 16 19:37:46 user nova-compute[86931]:   </sysinfo>
Nov 16 19:37:46 user nova-compute[86931]:   <os>
Nov 16 19:37:46 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:37:46 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:37:46 user nova-compute[86931]:   </os>
Nov 16 19:37:46 user nova-compute[86931]:   <features>
Nov 16 19:37:46 user nova-compute[86931]:     <acpi/>
Nov 16 19:37:46 user nova-compute[86931]:     <apic/>
Nov 16 19:37:46 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:37:46 user nova-compute[86931]:   </features>
Nov 16 19:37:46 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:37:46 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:37:46 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:37:46 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:37:46 user nova-compute[86931]:   </clock>
Nov 16 19:37:46 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:37:46 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:37:46 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:37:46 user nova-compute[86931]:   </cpu>
Nov 16 19:37:46 user nova-compute[86931]:   <devices>
Nov 16 19:37:46 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:37:46 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:37:46 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue"/>
Nov 16 19:37:46 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:37:46 user nova-compute[86931]:     </disk>
Nov 16 19:37:46 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:37:46 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:37:46 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk"/>
Nov 16 19:37:46 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:37:46 user nova-compute[86931]:     </disk>
Nov 16 19:37:46 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:37:46 user nova-compute[86931]:       <mac address="fa:16:3e:87:0e:0f"/>
Nov 16 19:37:46 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:46 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:37:46 user nova-compute[86931]:       <target dev="tapfdd6a513-8e"/>
Nov 16 19:37:46 user nova-compute[86931]:     </interface>
Nov 16 19:37:46 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:37:46 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/console.log" append="off"/>
Nov 16 19:37:46 user nova-compute[86931]:     </serial>
Nov 16 19:37:46 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:37:46 user nova-compute[86931]:     <video>
Nov 16 19:37:46 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:46 user nova-compute[86931]:     </video>
Nov 16 19:37:46 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:37:46 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:37:46 user nova-compute[86931]:     </rng>
Nov 16 19:37:46 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:37:46 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:37:46 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:37:46 user nova-compute[86931]:     </memballoon>
Nov 16 19:37:46 user nova-compute[86931]:   </devices>
Nov 16 19:37:46 user nova-compute[86931]: </domain>
Nov 16 19:37:46 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:37:46 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance destroyed successfully.
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:87:0e:0f, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26561663661653632', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561663661653632', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:37:46 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:37:46 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:37:46 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:37:46 user nova-compute[86931]:   <serial>3109c511-d67f-4091-8dd7-2a1203f2c648</serial>
Nov 16 19:37:46 user nova-compute[86931]: </disk>
Nov 16 19:37:46 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:fa:74:b7, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a45b30e9-7ea7-4ed7-a75a-4fd0c41dae04 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.412s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:47 user nova-compute[86931]: WARNING nova.compute.manager [req-276b27dd-85e7-4926-8ab6-c9bea4e809d3 req-5e75a7f3-9196-4884-8573-545131af39cc service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state active and task_state rescuing.
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:37:47 user nova-compute[86931]: INFO nova.compute.claims [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Claim successful on node user
Nov 16 19:37:47 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:37:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.policy [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cb60c70a2614868bc72b1748e15e9af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c2c364a21e43beac3f5cdded63caa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:37:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Creating image(s)
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "/opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "/opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "/opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk 1073741824" returned: 0 in 0.077s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Successfully created port: eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Cannot resize image /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Ensure instance console log exists: /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:49 user nova-compute[86931]: WARNING nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state active and task_state rescuing.
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:49 user nova-compute[86931]: WARNING nova.compute.manager [req-2e06989c-9424-4ad4-94b0-d1ee8876c8b1 req-19281379-0756-4b0a-b464-e68b87d993ad service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state active and task_state rescuing.
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [{"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-04ec3edd-f329-47d3-84df-85343c9b4336" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-11ecf6b9-13ae-4616-9cca-92aea72b7aac tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Successfully updated port: eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquired lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-changed-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Refreshing instance network info cache due to event network-changed-eac561b1-f13c-4fb9-90de-f07f7554c9c6. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] Acquiring lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:37:50 user nova-compute[86931]: INFO nova.compute.claims [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Claim successful on node user
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:37:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Updating instance_info_cache with network_info: [{"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Releasing lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Instance network_info: |[{"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] Acquired lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Refreshing network info cache for port eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Start _get_guest_xml network_info=[{"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:37:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1326498883',display_name='tempest-VolumesActionsTest-instance-1326498883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1326498883',id=34,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3c2c364a21e43beac3f5cdded63caa1',ramdisk_id='',reservation_id='r-gf2xdswf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1763718822',owner_user_name='tempest-VolumesActionsTest-1763718822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:48Z,user_data=None,user_id='3cb60c70a2614868bc72b1748e15e9af',uuid=3312eed6-2405-4741-9e3a-d847ceb52be6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converting VIF {"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lazy-loading 'pci_devices' on Instance uuid 3312eed6-2405-4741-9e3a-d847ceb52be6 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:37:51 user nova-compute[86931]:   <uuid>3312eed6-2405-4741-9e3a-d847ceb52be6</uuid>
Nov 16 19:37:51 user nova-compute[86931]:   <name>instance-00000022</name>
Nov 16 19:37:51 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:37:51 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:37:51 user nova-compute[86931]:   <metadata>
Nov 16 19:37:51 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:37:51 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:name>tempest-VolumesActionsTest-instance-1326498883</nova:name>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:37:51</nova:creationTime>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:37:51 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:37:51 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:owner>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:user uuid="3cb60c70a2614868bc72b1748e15e9af">tempest-VolumesActionsTest-1763718822-project-member</nova:user>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:project uuid="c3c2c364a21e43beac3f5cdded63caa1">tempest-VolumesActionsTest-1763718822</nova:project>
Nov 16 19:37:51 user nova-compute[86931]:       </nova:owner>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:37:51 user nova-compute[86931]:       <nova:ports>
Nov 16 19:37:51 user nova-compute[86931]:         <nova:port uuid="eac561b1-f13c-4fb9-90de-f07f7554c9c6">
Nov 16 19:37:51 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 19:37:51 user nova-compute[86931]:         </nova:port>
Nov 16 19:37:51 user nova-compute[86931]:       </nova:ports>
Nov 16 19:37:51 user nova-compute[86931]:     </nova:instance>
Nov 16 19:37:51 user nova-compute[86931]:   </metadata>
Nov 16 19:37:51 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:37:51 user nova-compute[86931]:     <system>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="serial">3312eed6-2405-4741-9e3a-d847ceb52be6</entry>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="uuid">3312eed6-2405-4741-9e3a-d847ceb52be6</entry>
Nov 16 19:37:51 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:37:51 user nova-compute[86931]:     </system>
Nov 16 19:37:51 user nova-compute[86931]:   </sysinfo>
Nov 16 19:37:51 user nova-compute[86931]:   <os>
Nov 16 19:37:51 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:37:51 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:37:51 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:37:51 user nova-compute[86931]:   </os>
Nov 16 19:37:51 user nova-compute[86931]:   <features>
Nov 16 19:37:51 user nova-compute[86931]:     <acpi/>
Nov 16 19:37:51 user nova-compute[86931]:     <apic/>
Nov 16 19:37:51 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:37:51 user nova-compute[86931]:   </features>
Nov 16 19:37:51 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:37:51 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:37:51 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:37:51 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:37:51 user nova-compute[86931]:   </clock>
Nov 16 19:37:51 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:37:51 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:37:51 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:37:51 user nova-compute[86931]:   </cpu>
Nov 16 19:37:51 user nova-compute[86931]:   <devices>
Nov 16 19:37:51 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:37:51 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:37:51 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk"/>
Nov 16 19:37:51 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:37:51 user nova-compute[86931]:     </disk>
Nov 16 19:37:51 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:37:51 user nova-compute[86931]:       <mac address="fa:16:3e:58:64:c8"/>
Nov 16 19:37:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:51 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:37:51 user nova-compute[86931]:       <target dev="tapeac561b1-f1"/>
Nov 16 19:37:51 user nova-compute[86931]:     </interface>
Nov 16 19:37:51 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:37:51 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/console.log" append="off"/>
Nov 16 19:37:51 user nova-compute[86931]:     </serial>
Nov 16 19:37:51 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:37:51 user nova-compute[86931]:     <video>
Nov 16 19:37:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:51 user nova-compute[86931]:     </video>
Nov 16 19:37:51 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:37:51 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:37:51 user nova-compute[86931]:     </rng>
Nov 16 19:37:51 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:37:51 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:37:51 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:37:51 user nova-compute[86931]:     </memballoon>
Nov 16 19:37:51 user nova-compute[86931]:   </devices>
Nov 16 19:37:51 user nova-compute[86931]: </domain>
Nov 16 19:37:51 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1326498883',display_name='tempest-VolumesActionsTest-instance-1326498883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1326498883',id=34,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3c2c364a21e43beac3f5cdded63caa1',ramdisk_id='',reservation_id='r-gf2xdswf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1763718822',owner_user_name='tempest-VolumesActionsTest-1763718822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:48Z,user_data=None,user_id='3cb60c70a2614868bc72b1748e15e9af',uuid=3312eed6-2405-4741-9e3a-d847ceb52be6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converting VIF {"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG os_vif [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61377670-e6db-5eae-a502-56eb9e67bb36', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac561b1-f1, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeac561b1-f1, col_values=(('qos', UUID('0cbc878c-7eb6-4b36-9088-0151e76e9bb3')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeac561b1-f1, col_values=(('external_ids', {'iface-id': 'eac561b1-f13c-4fb9-90de-f07f7554c9c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:64:c8', 'vm-uuid': '3312eed6-2405-4741-9e3a-d847ceb52be6'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:51 user nova-compute[86931]: INFO os_vif [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1')
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] No VIF found with MAC fa:16:3e:58:64:c8, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.734s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:37:51 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Updated VIF entry in instance network info cache for port eac561b1-f13c-4fb9-90de-f07f7554c9c6. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Updating instance_info_cache with network_info: [{"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.policy [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7112607a7774345b8879d0422b8b94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ee3cb7b348423c81c90a733038d9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-df1a991c-d78e-4a7c-83c9-2e558feb3310 req-e62e191a-3741-43a4-9fac-a2d8a48a78bd service nova] Releasing lock "refresh_cache-3312eed6-2405-4741-9e3a-d847ceb52be6" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:37:51 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Creating image(s)
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "/opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.204s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk 1073741824" returned: 0 in 0.063s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Successfully created port: ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Cannot resize image /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Ensure instance console log exists: /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:52 user nova-compute[86931]: DEBUG nova.compute.manager [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] No waiting events found dispatching network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:52 user nova-compute[86931]: WARNING nova.compute.manager [req-bd21021e-59a5-4140-bc8a-ec4bbef79772 req-58d3ed2a-4385-4928-8df7-49f1f9e181c3 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received unexpected event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 for instance with vm_state building and task_state spawning.
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Successfully updated port: ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquired lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-changed-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Refreshing instance network info cache due to event network-changed-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] Acquiring lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updating instance_info_cache with network_info: [{"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Releasing lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Instance network_info: |[{"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] Acquired lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.neutron [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Refreshing network info cache for port ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Start _get_guest_xml network_info=[{"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:37:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1052603362',display_name='tempest-AttachVolumeNegativeTest-server-1052603362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1052603362',id=35,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKPFZdIarWOUaMrfRnTY+vdLAKR8teKnAtlK5shT8/TuwMGlr8bxTSYHKV99rkUDxMuq46GYjv5KiD39WyM9F6jPL9/ZGJtWPAUYLYLoybi8u1BTsrLoFjpJcAamnUPHw==',key_name='tempest-keypair-1287209983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-w2p2dgi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=047cc254-2067-4e86-aee7-df4a3c79bc7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'pci_devices' on Instance uuid 047cc254-2067-4e86-aee7-df4a3c79bc7f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:37:53 user nova-compute[86931]:   <uuid>047cc254-2067-4e86-aee7-df4a3c79bc7f</uuid>
Nov 16 19:37:53 user nova-compute[86931]:   <name>instance-00000023</name>
Nov 16 19:37:53 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:37:53 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:37:53 user nova-compute[86931]:   <metadata>
Nov 16 19:37:53 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:37:53 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1052603362</nova:name>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:37:53</nova:creationTime>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:37:53 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:37:53 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:owner>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:user uuid="d7112607a7774345b8879d0422b8b94c">tempest-AttachVolumeNegativeTest-57450610-project-member</nova:user>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:project uuid="a3ee3cb7b348423c81c90a733038d9ff">tempest-AttachVolumeNegativeTest-57450610</nova:project>
Nov 16 19:37:53 user nova-compute[86931]:       </nova:owner>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:37:53 user nova-compute[86931]:       <nova:ports>
Nov 16 19:37:53 user nova-compute[86931]:         <nova:port uuid="ba2ef801-7116-4fc8-bbc6-70ac82ec3db2">
Nov 16 19:37:53 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:37:53 user nova-compute[86931]:         </nova:port>
Nov 16 19:37:53 user nova-compute[86931]:       </nova:ports>
Nov 16 19:37:53 user nova-compute[86931]:     </nova:instance>
Nov 16 19:37:53 user nova-compute[86931]:   </metadata>
Nov 16 19:37:53 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:37:53 user nova-compute[86931]:     <system>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="serial">047cc254-2067-4e86-aee7-df4a3c79bc7f</entry>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="uuid">047cc254-2067-4e86-aee7-df4a3c79bc7f</entry>
Nov 16 19:37:53 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:37:53 user nova-compute[86931]:     </system>
Nov 16 19:37:53 user nova-compute[86931]:   </sysinfo>
Nov 16 19:37:53 user nova-compute[86931]:   <os>
Nov 16 19:37:53 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:37:53 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:37:53 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:37:53 user nova-compute[86931]:   </os>
Nov 16 19:37:53 user nova-compute[86931]:   <features>
Nov 16 19:37:53 user nova-compute[86931]:     <acpi/>
Nov 16 19:37:53 user nova-compute[86931]:     <apic/>
Nov 16 19:37:53 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:37:53 user nova-compute[86931]:   </features>
Nov 16 19:37:53 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:37:53 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:37:53 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:37:53 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:37:53 user nova-compute[86931]:   </clock>
Nov 16 19:37:53 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:37:53 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:37:53 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:37:53 user nova-compute[86931]:   </cpu>
Nov 16 19:37:53 user nova-compute[86931]:   <devices>
Nov 16 19:37:53 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:37:53 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:37:53 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk"/>
Nov 16 19:37:53 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:37:53 user nova-compute[86931]:     </disk>
Nov 16 19:37:53 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:37:53 user nova-compute[86931]:       <mac address="fa:16:3e:4e:ba:09"/>
Nov 16 19:37:53 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:53 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:37:53 user nova-compute[86931]:       <target dev="tapba2ef801-71"/>
Nov 16 19:37:53 user nova-compute[86931]:     </interface>
Nov 16 19:37:53 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:37:53 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/console.log" append="off"/>
Nov 16 19:37:53 user nova-compute[86931]:     </serial>
Nov 16 19:37:53 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:37:53 user nova-compute[86931]:     <video>
Nov 16 19:37:53 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:37:53 user nova-compute[86931]:     </video>
Nov 16 19:37:53 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:37:53 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:37:53 user nova-compute[86931]:     </rng>
Nov 16 19:37:53 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:37:53 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:37:53 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:37:53 user nova-compute[86931]:     </memballoon>
Nov 16 19:37:53 user nova-compute[86931]:   </devices>
Nov 16 19:37:53 user nova-compute[86931]: </domain>
Nov 16 19:37:53 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1052603362',display_name='tempest-AttachVolumeNegativeTest-server-1052603362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1052603362',id=35,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKPFZdIarWOUaMrfRnTY+vdLAKR8teKnAtlK5shT8/TuwMGlr8bxTSYHKV99rkUDxMuq46GYjv5KiD39WyM9F6jPL9/ZGJtWPAUYLYLoybi8u1BTsrLoFjpJcAamnUPHw==',key_name='tempest-keypair-1287209983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-w2p2dgi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=047cc254-2067-4e86-aee7-df4a3c79bc7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG os_vif [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96b2358a-3ec7-55af-82ee-721e9f0e67ea', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba2ef801-71, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba2ef801-71, col_values=(('qos', UUID('98c14c9d-be62-477f-ad5c-0a94a945a5da')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba2ef801-71, col_values=(('external_ids', {'iface-id': 'ba2ef801-7116-4fc8-bbc6-70ac82ec3db2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:ba:09', 'vm-uuid': '047cc254-2067-4e86-aee7-df4a3c79bc7f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:53 user nova-compute[86931]: INFO os_vif [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71')
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:4e:ba:09, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updated VIF entry in instance network info cache for port ba2ef801-7116-4fc8-bbc6-70ac82ec3db2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updating instance_info_cache with network_info: [{"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-08da3b5a-d80b-4740-ba8a-1663b61b08a3 req-bdad13a7-0ad4-4407-96a7-fe938491fc9c service nova] Releasing lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] No waiting events found dispatching network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:55 user nova-compute[86931]: WARNING nova.compute.manager [req-27a048bd-f486-4432-b5fe-143595c9df86 req-8085a127-ce80-4051-a6a4-84c86a0805ae service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received unexpected event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 for instance with vm_state building and task_state spawning.
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Instance spawned successfully.
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:55 user nova-compute[86931]: INFO nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:55 user nova-compute[86931]: INFO nova.compute.manager [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Took 8.12 seconds to build instance.
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] No waiting events found dispatching network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:55 user nova-compute[86931]: WARNING nova.compute.manager [req-68bedf5f-a12c-4f3c-a24e-7142fa4e1faf req-e606d76f-1544-4c9c-b85a-8ca536e0a229 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received unexpected event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 for instance with vm_state building and task_state spawning.
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0f37f500-76ae-4be4-a1b5-81918e9f57be tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.216s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:37:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:37:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:37:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] No waiting events found dispatching network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:37:58 user nova-compute[86931]: WARNING nova.compute.manager [req-e30c19e9-4f48-4f8c-bc34-fe8ded67bb8f req-6396d0e9-908a-4009-8558-06be80ff890b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received unexpected event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 for instance with vm_state building and task_state spawning.
Nov 16 19:37:58 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:58 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7531MB free_disk=25.040924072265625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:37:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Instance spawned successfully.
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:37:58 user nova-compute[86931]: INFO nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a6231ab3-ae23-4b87-926c-86fd9e0a357b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a29e474f-1d9d-49e8-bccb-b252d7168ab1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3312eed6-2405-4741-9e3a-d847ceb52be6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 047cc254-2067-4e86-aee7-df4a3c79bc7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:37:58 user nova-compute[86931]: INFO nova.compute.manager [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Took 7.88 seconds to build instance.
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c110fc41-d3ed-49b0-af87-90861ece3d7f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.091s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:37:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 8d74eef2-f3a7-4063-95a5-4f13304c9d8f {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid afe35609-1004-4958-9893-d82894b6f297 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid f8e118ca-5ace-4f2f-964d-9e9638950d00 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 105dd9f1-9f20-4f05-8dd4-ad360886dc09 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid a29e474f-1d9d-49e8-bccb-b252d7168ab1 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 3312eed6-2405-4741-9e3a-d847ceb52be6 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 047cc254-2067-4e86-aee7-df4a3c79bc7f {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "afe35609-1004-4958-9893-d82894b6f297" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "afe35609-1004-4958-9893-d82894b6f297" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:05 user nova-compute[86931]: INFO nova.compute.manager [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Unshelving
Nov 16 19:38:05 user nova-compute[86931]: INFO nova.virt.block_device [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Booting with volume 729dde0f-e35c-49bc-8fcb-244e1ab4316a at /dev/vdc
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.utils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb42e0-f1a0-4ab0-a7c0-cfa01c505b3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b3a368-bf72-4e6f-944d-d0ac2ab5ae61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddcbd9-c4a3-449f-abfe-94a61f33dcca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcc02ee-9769-4bbc-88c9-e8fc5591211e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:38:05 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:38:05 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99cc212-e6f4-450a-a0d7-727d00ef0078]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG os_brick.utils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:38:05 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating existing volume attachment record: 7bfba928-33b8-45e0-ba78-076fdbee3845 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:38:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:09 user nova-compute[86931]: INFO nova.compute.manager [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Terminating instance
Nov 16 19:38:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-unplugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] No waiting events found dispatching network-vif-unplugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-b226083c-1dae-423b-b031-7d31389701d0 req-4bda5b3f-fbcc-47c8-af57-b7980fc97382 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-unplugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:38:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Instance destroyed successfully.
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lazy-loading 'resources' on Instance uuid a6231ab3-ae23-4b87-926c-86fd9e0a357b {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1498521135',display_name='tempest-SnapshotDataIntegrityTests-server-1498521135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1498521135',id=24,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJJJM4hrNGsz9saVxTFgl1KPxeqWquQgfdrHnf/MfcbUpL4Obtn0BtWZCHh/qRZcDP5RQneO9AnvXtu7qxq/sZ2rVXTdK+hzVDWzpC31nYVhCm8wyCogc3NfFp/pGSz7w==',key_name='tempest-keypair-1841072874',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:31:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='501231dd92fd4ad0ba93e6d5c1f99394',ramdisk_id='',reservation_id='r-n01gg0uf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-408275298',owner_user_name='tempest-SnapshotDataIntegrityTests-408275298-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c4e8c35419648338cc81c64a9e1fef6',uuid=a6231ab3-ae23-4b87-926c-86fd9e0a357b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converting VIF {"id": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "address": "fa:16:3e:63:da:94", "network": {"id": "3a4c22cf-f1c2-4952-82be-d95a7c66dddd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1743853012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501231dd92fd4ad0ba93e6d5c1f99394", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fe5f2e1-f3", "ovs_interfaceid": "1fe5f2e1-f3a1-4ef0-8502-251147e0b400", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG os_vif [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fe5f2e1-f3, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f23f88de-a4a0-4ef8-bde8-ab9c3870f6d2) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:10 user nova-compute[86931]: INFO os_vif [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:da:94,bridge_name='br-int',has_traffic_filtering=True,id=1fe5f2e1-f3a1-4ef0-8502-251147e0b400,network=Network(3a4c22cf-f1c2-4952-82be-d95a7c66dddd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fe5f2e1-f3')
Nov 16 19:38:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Deleting instance files /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b_del
Nov 16 19:38:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Deletion of /opt/stack/data/nova/instances/a6231ab3-ae23-4b87-926c-86fd9e0a357b_del complete
Nov 16 19:38:10 user nova-compute[86931]: INFO nova.compute.manager [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 19:38:10 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:38:10 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:11 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Took 0.73 seconds to deallocate network for instance.
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-41947ab7-3d69-4249-b0df-00acee899f2d req-7608fd5c-0d6d-4f72-8daa-9a70f7a16518 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-deleted-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:11 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Deleted allocations for instance a6231ab3-ae23-4b87-926c-86fd9e0a357b
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_requests' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:38:11 user nova-compute[86931]: INFO nova.compute.claims [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Claim successful on node user
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0d294f9d-0722-41d3-9627-4c975a12d26a tempest-SnapshotDataIntegrityTests-408275298 tempest-SnapshotDataIntegrityTests-408275298-project-member] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] Acquiring lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] Lock "a6231ab3-ae23-4b87-926c-86fd9e0a357b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] No waiting events found dispatching network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:11 user nova-compute[86931]: WARNING nova.compute.manager [req-e18e0587-1e53-4f5c-8fd1-2a0a96552238 req-c1548dd0-d84c-47e0-8958-398ed65123a9 service nova] [instance: a6231ab3-ae23-4b87-926c-86fd9e0a357b] Received unexpected event network-vif-plugged-1fe5f2e1-f3a1-4ef0-8502-251147e0b400 for instance with vm_state deleted and task_state None.
Nov 16 19:38:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:12 user nova-compute[86931]: INFO nova.network.neutron [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating port b06d9c28-33e4-492a-9e67-a69ec3b768e8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:38:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing instance network info cache due to event network-changed-b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:38:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Creating image(s)
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Refreshing network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG nova.objects.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "e3bb88851fa63486419133e2b66fa4b740823c4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "e3bb88851fa63486419133e2b66fa4b740823c4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.part --force-share --output=json" returned: 0 in 0.243s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG nova.virt.images [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] 4feb64ee-7b94-4b3b-8ae4-e35218ba8137 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.part /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updated VIF entry in instance network info cache for port b06d9c28-33e4-492a-9e67-a69ec3b768e8. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-331a26a6-0faa-4d33-ba32-e897b378d12e req-881b95e9-ccca-4716-a9d6-60faf0664e26 service nova] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.part /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.converted" returned: 0 in 0.358s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "e3bb88851fa63486419133e2b66fa4b740823c4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.837s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "e3bb88851fa63486419133e2b66fa4b740823c4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "e3bb88851fa63486419133e2b66fa4b740823c4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b,backing_fmt=raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b,backing_fmt=raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk 1073741824" returned: 0 in 0.049s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "e3bb88851fa63486419133e2b66fa4b740823c4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'migration_context' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG nova.objects.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:38:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Rebasing disk image.
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 -F raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 -F raw /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk" returned: 0 in 2.321s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start _get_guest_xml network_info=[{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='49dfadaabefed1f74db6449499c1b51b',container_format='bare',created_at=2023-11-16T19:36:13Z,direct_url=<?>,disk_format='qcow2',id=4feb64ee-7b94-4b3b-8ae4-e35218ba8137,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-616727702-shelved',owner='6184534338e74f3d827b9aee3e20c617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:36:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '7bfba928-33b8-45e0-ba78-076fdbee3845', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBXYMrxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0', 'attached_at': '', 'detached_at': '', 'volume_id': '729dde0f-e35c-49bc-8fcb-244e1ab4316a', 'serial': '729dde0f-e35c-49bc-8fcb-244e1ab4316a'}, 'boot_index': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:38:18 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:38:18 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='49dfadaabefed1f74db6449499c1b51b',container_format='bare',created_at=2023-11-16T19:36:13Z,direct_url=<?>,disk_format='qcow2',id=4feb64ee-7b94-4b3b-8ae4-e35218ba8137,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-616727702-shelved',owner='6184534338e74f3d827b9aee3e20c617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:36:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.objects.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBXYMrxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:38:18 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:38:18 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:38:18 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ad54c-6b17-49fd-8c42-269d2d23d573]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:38:18 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80604f61-0efa-4cc7-8774-2b29791938f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a] added
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4449aedd-f37c-41e2-a7b4-3983b0d6158d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e60fab-6ceb-461d-a73b-b64b29e27e0f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBXYMrxl {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tBXYMrxl" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465d8fc-6bbe-4c69-9ca3-6e61eae8ea96]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tBXYMrxl'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754408b-1945-499c-9545-de6f18f4ff67]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd3177-be45-450f-a34a-8674f4a4bc80]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda84ff4-2eda-446f-a45c-d7e8ae05798e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260]
Nov 16 19:38:18 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260] successful.
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c1e0e-8115-4105-bf60-0e3f129e4241]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897df23-ebc9-46e6-9fc0-19e9d47fdf5b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:18 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:38:18 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74272af-c5fc-456b-89f3-f801a72f6cba]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBXYMrxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23236633439393537', 'path': '/dev/sdg'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236633439393537', 'path': '/dev/sdg'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='4feb64ee-7b94-4b3b-8ae4-e35218ba8137',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2010505057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:36:17.887793',shelved_host='user',shelved_image_id='4feb64ee-7b94-4b3b-8ae4-e35218ba8137'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.objects.base [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:38:19 user nova-compute[86931]:   <uuid>8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</uuid>
Nov 16 19:38:19 user nova-compute[86931]:   <name>instance-0000001c</name>
Nov 16 19:38:19 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:38:19 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:38:19 user nova-compute[86931]:   <metadata>
Nov 16 19:38:19 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:38:19 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-616727702</nova:name>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:38:18</nova:creationTime>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:38:19 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:38:19 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:owner>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:user uuid="a00a0387df984129850f1fb1e29a35ce">tempest-AttachVolumeShelveTestJSON-470403389-project-member</nova:user>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:project uuid="6184534338e74f3d827b9aee3e20c617">tempest-AttachVolumeShelveTestJSON-470403389</nova:project>
Nov 16 19:38:19 user nova-compute[86931]:       </nova:owner>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:root type="image" uuid="4feb64ee-7b94-4b3b-8ae4-e35218ba8137"/>
Nov 16 19:38:19 user nova-compute[86931]:       <nova:ports>
Nov 16 19:38:19 user nova-compute[86931]:         <nova:port uuid="b06d9c28-33e4-492a-9e67-a69ec3b768e8">
Nov 16 19:38:19 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:38:19 user nova-compute[86931]:         </nova:port>
Nov 16 19:38:19 user nova-compute[86931]:       </nova:ports>
Nov 16 19:38:19 user nova-compute[86931]:     </nova:instance>
Nov 16 19:38:19 user nova-compute[86931]:   </metadata>
Nov 16 19:38:19 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:38:19 user nova-compute[86931]:     <system>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="serial">8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</entry>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="uuid">8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0</entry>
Nov 16 19:38:19 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:38:19 user nova-compute[86931]:     </system>
Nov 16 19:38:19 user nova-compute[86931]:   </sysinfo>
Nov 16 19:38:19 user nova-compute[86931]:   <os>
Nov 16 19:38:19 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:38:19 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:38:19 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:38:19 user nova-compute[86931]:   </os>
Nov 16 19:38:19 user nova-compute[86931]:   <features>
Nov 16 19:38:19 user nova-compute[86931]:     <acpi/>
Nov 16 19:38:19 user nova-compute[86931]:     <apic/>
Nov 16 19:38:19 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:38:19 user nova-compute[86931]:   </features>
Nov 16 19:38:19 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:38:19 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:38:19 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:38:19 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:38:19 user nova-compute[86931]:   </clock>
Nov 16 19:38:19 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:38:19 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:38:19 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:38:19 user nova-compute[86931]:   </cpu>
Nov 16 19:38:19 user nova-compute[86931]:   <devices>
Nov 16 19:38:19 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:38:19 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:38:19 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk"/>
Nov 16 19:38:19 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:38:19 user nova-compute[86931]:     </disk>
Nov 16 19:38:19 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:38:19 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:38:19 user nova-compute[86931]:       <source dev="/dev/sdg"/>
Nov 16 19:38:19 user nova-compute[86931]:       <target dev="vdc" bus="virtio"/>
Nov 16 19:38:19 user nova-compute[86931]:       <serial>729dde0f-e35c-49bc-8fcb-244e1ab4316a</serial>
Nov 16 19:38:19 user nova-compute[86931]:     </disk>
Nov 16 19:38:19 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:38:19 user nova-compute[86931]:       <mac address="fa:16:3e:9b:c8:50"/>
Nov 16 19:38:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:38:19 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:38:19 user nova-compute[86931]:       <target dev="tapb06d9c28-33"/>
Nov 16 19:38:19 user nova-compute[86931]:     </interface>
Nov 16 19:38:19 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:38:19 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/console.log" append="off"/>
Nov 16 19:38:19 user nova-compute[86931]:     </serial>
Nov 16 19:38:19 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:38:19 user nova-compute[86931]:     <video>
Nov 16 19:38:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:38:19 user nova-compute[86931]:     </video>
Nov 16 19:38:19 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:38:19 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:38:19 user nova-compute[86931]:     </rng>
Nov 16 19:38:19 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:38:19 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:38:19 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:38:19 user nova-compute[86931]:     </memballoon>
Nov 16 19:38:19 user nova-compute[86931]:   </devices>
Nov 16 19:38:19 user nova-compute[86931]: </domain>
Nov 16 19:38:19 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='4feb64ee-7b94-4b3b-8ae4-e35218ba8137',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2010505057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:36:17.887793',shelved_host='user',shelved_image_id='4feb64ee-7b94-4b3b-8ae4-e35218ba8137'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG os_vif [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '751aac3e-5608-53b4-b2b5-31c7d2aaec0c', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb06d9c28-33, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb06d9c28-33, col_values=(('qos', UUID('a9e96dd3-fa6e-4bc9-89e6-d738a5c32435')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb06d9c28-33, col_values=(('external_ids', {'iface-id': 'b06d9c28-33e4-492a-9e67-a69ec3b768e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c8:50', 'vm-uuid': '8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:19 user nova-compute[86931]: INFO os_vif [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33')
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:38:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No VIF found with MAC fa:16:3e:9b:c8:50, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:38:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:21 user nova-compute[86931]: WARNING nova.compute.manager [req-5e06480c-7813-4dc3-838a-af7794b3bae2 req-8616c915-9195-4e27-8873-ecbe92977640 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:23 user nova-compute[86931]: WARNING nova.compute.manager [req-bdbdc8ee-219e-415f-9b56-d742cd9184db req-af36b40c-7206-4ef3-ae0c-df3df4fb2164 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 19:38:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:38:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance spawned successfully.
Nov 16 19:38:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:38:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5a7a00c9-764f-4116-804e-6e905ff7d6b2 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.952s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:38:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:45 user nova-compute[86931]: INFO nova.compute.manager [None req-33786a45-41d2-496f-9949-8a651a8ffc90 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Get console output
Nov 16 19:38:46 user nova-compute[86931]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 19:38:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:38:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:38:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:38:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updating instance_info_cache with network_info: [{"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-f8e118ca-5ace-4f2f-964d-9e9638950d00" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:52 user nova-compute[86931]: INFO nova.compute.manager [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Terminating instance
Nov 16 19:38:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-76bcd1ec-5684-48de-9a1f-e6939dce0f76 req-e3222672-952b-4d00-8b23-ab9b2bfaca65 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-unplugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Instance destroyed successfully.
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid 3f799e54-3a33-4e78-b043-dce4e012701f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1910491494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1910491494',id=27,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-ykgsiy3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:37:06Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=3f799e54-3a33-4e78-b043-dce4e012701f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "538e3e11-ab42-42f7-97cf-0a3a56755514", "address": "fa:16:3e:72:3e:5d", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538e3e11-ab", "ovs_interfaceid": "538e3e11-ab42-42f7-97cf-0a3a56755514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_vif [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap538e3e11-ab, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e477fb77-0c01-4cc2-929f-11a8c9cbcaae) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:38:53 user nova-compute[86931]: INFO os_vif [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:3e:5d,bridge_name='br-int',has_traffic_filtering=True,id=538e3e11-ab42-42f7-97cf-0a3a56755514,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538e3e11-ab')
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YKCcSAjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:38:53 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49eb552-d367-4daf-a0c9-cce412fdf5cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:38:53 user nova-compute[86931]: No targets found.
Nov 16 19:38:53 user nova-compute[86931]: iSNS:
Nov 16 19:38:53 user nova-compute[86931]: No targets found.
Nov 16 19:38:53 user nova-compute[86931]: STATIC:
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:38:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:38:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:38:53 user nova-compute[86931]: FIRMWARE:
Nov 16 19:38:53 user nova-compute[86931]: No targets found.
Nov 16 19:38:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:38:53 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:38:53 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3994b32-be09-406f-a2fb-ebc0888a81c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac57d55-4639-440c-88ea-36a733f90335]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:38:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:38:53 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:38:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c62b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2941ea-a45c-456b-82e0-4b3768580470]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2735e-e455-4167-803f-3c3014ef61ae]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564fb6b-b502-41a1-a461-b5419a9abfc8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ffbb1-b174-4e65-9538-d07fc1e6132d]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d016f370-2552-4dd5-9713-e93bb5098bf9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb05e88-27d6-4c05-8552-22dd1719be84]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260]
Nov 16 19:38:54 user nova-compute[86931]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e, portal: 172.16.0.220,3260] successful.
Nov 16 19:38:54 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9161aa5a-0600-4b27-a9bf-04cf5708b67e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a65b51-0d79-4d6d-a722-bba6aced73e4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== disconnect_volume: return (432ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:38:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Deleting instance files /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f_del
Nov 16 19:38:54 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Deletion of /opt/stack/data/nova/instances/3f799e54-3a33-4e78-b043-dce4e012701f_del complete
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: INFO nova.compute.manager [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:54 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Took 0.51 seconds to deallocate network for instance.
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-f645516e-349a-4c19-8257-e07f978d1cb7 req-d244bd90-b923-4510-a96f-8829d853d143 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-deleted-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:54 user nova-compute[86931]: INFO nova.compute.manager [req-f645516e-349a-4c19-8257-e07f978d1cb7 req-d244bd90-b923-4510-a96f-8829d853d143 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Neutron deleted interface 538e3e11-ab42-42f7-97cf-0a3a56755514; detaching it from the instance and deleting it from the info cache
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-f645516e-349a-4c19-8257-e07f978d1cb7 req-d244bd90-b923-4510-a96f-8829d853d143 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-f645516e-349a-4c19-8257-e07f978d1cb7 req-d244bd90-b923-4510-a96f-8829d853d143 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Detach interface failed, port_id=538e3e11-ab42-42f7-97cf-0a3a56755514, reason: Instance 3f799e54-3a33-4e78-b043-dce4e012701f could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:38:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] Acquiring lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] Lock "3f799e54-3a33-4e78-b043-dce4e012701f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] No waiting events found dispatching network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:38:55 user nova-compute[86931]: WARNING nova.compute.manager [req-ec22a7e8-01da-4f12-81ae-10cf673adac4 req-f32400c4-c7ff-425a-9bce-632630cca634 service nova] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Received unexpected event network-vif-plugged-538e3e11-ab42-42f7-97cf-0a3a56755514 for instance with vm_state active and task_state deleting.
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:38:55 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid '3f799e54-3a33-4e78-b043-dce4e012701f' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid '3f799e54-3a33-4e78-b043-dce4e012701f' (instance-0000001b)
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:38:55 user nova-compute[86931]: INFO nova.compute.manager [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 3f799e54-3a33-4e78-b043-dce4e012701f] Took 1.05 seconds to detach 1 volumes for instance.
Nov 16 19:38:55 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:38:55 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7098MB free_disk=24.984554290771484GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f8e118ca-5ace-4f2f-964d-9e9638950d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3f799e54-3a33-4e78-b043-dce4e012701f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a29e474f-1d9d-49e8-bccb-b252d7168ab1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 3312eed6-2405-4741-9e3a-d847ceb52be6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 047cc254-2067-4e86-aee7-df4a3c79bc7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:38:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.448s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:56 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Deleted allocations for instance 3f799e54-3a33-4e78-b043-dce4e012701f
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f1663ee2-34f2-4f1e-8801-93bdd0698ef2 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "3f799e54-3a33-4e78-b043-dce4e012701f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.936s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:38:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:38:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing instance network info cache due to event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:39:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] Acquiring lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:39:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] Acquired lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:39:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:39:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updated VIF entry in instance network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:39:06 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating instance_info_cache with network_info: [{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e736841-f4c7-42f7-ba37-bbed53df3fec req-a4c39b25-84d9-45b9-b704-6a4274bb7e3c service nova] Releasing lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:39:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:39:11 user nova-compute[86931]: INFO nova.compute.claims [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Claim successful on node user
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:39:11 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.policy [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4267a07b6ed4016a246e2eca5a019f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae1bbd144fb4a83988126b487c7874c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:39:11 user nova-compute[86931]: INFO nova.virt.block_device [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Booting with volume 5005ad20-d8ea-49e6-8f64-f69c00b09ff1 at /dev/vda
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed4441-68e8-4437-8a8e-d9433434ff96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1498b-fe21-42bd-a1a2-c1d487a78693]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4f78c-11a4-4d5e-8bd4-93583c8a2ccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f0786-ccbc-42d4-85d7-3ba825340947]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:39:11 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:39:11 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[49acb2b4-91ff-4949-ac0f-46bcc5cffb5c]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG os_brick.utils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:39:11 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating existing volume attachment record: 96ca646d-614a-44e0-8de0-b0212be7e159 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:39:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Successfully created port: a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Successfully updated port: a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquired lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing instance network info cache due to event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] Acquiring lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Releasing lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Instance network_info: |[{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] Acquired lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updated VIF entry in instance network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d3dc3b2b-4c2d-41f5-ab2d-ea2a9d2a1675 req-f93167fd-92c7-486d-bedc-f193f26ccdd1 service nova] Releasing lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:39:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Creating image(s)
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Ensure instance console log exists: /opt/stack/data/nova/instances/13977575-a28b-46da-8d40-b3cfe74f6c6f/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Start _get_guest_xml network_info=[{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '96ca646d-614a-44e0-8de0-b0212be7e159', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFRUpncu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13977575-a28b-46da-8d40-b3cfe74f6c6f', 'attached_at': '', 'detached_at': '', 'volume_id': '5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 'serial': '5005ad20-d8ea-49e6-8f64-f69c00b09ff1'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:39:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:39:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFRUpncu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:39:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:39:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:39:17 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:39:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab15c2-31d5-46b1-83fa-bfcf910b7213]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:39:17 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675bcca-b4aa-4409-a0d7-ba9011dfdc3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1] added
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063b2fb-3b5c-4d61-9dd4-d3e44e76bda6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94e892-9419-4b19-8f77-7df41e2d6ef9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFRUpncu {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFRUpncu" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[071957b6-add0-4f81-ba6b-dfb3ddf051d0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wFRUpncu'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2551b2-1951-49fd-92db-fa7a24e6b2aa]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a1cddc-50be-425a-952e-8cce38f512c5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163aedb-8027-4c0f-88fb-5da4fa3bc441]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260]
Nov 16 19:39:17 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260] successful.
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff73ac8-d029-4dbc-8110-a635a291a463]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f222c08a-d2ba-4c72-8e65-77794f3ff0de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:17 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:39:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[03358243-f9c4-4008-a0f7-d8d28d36d8ef]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:39:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFRUpncu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23465333933646364', 'path': '/dev/sdf'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465333933646364', 'path': '/dev/sdf'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136583056',display_name='tempest-TestVolumeBootPattern-server-1136583056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136583056',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-t4b9907w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:39:12Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=13977575-a28b-46da-8d40-b3cfe74f6c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'pci_devices' on Instance uuid 13977575-a28b-46da-8d40-b3cfe74f6c6f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:39:18 user nova-compute[86931]:   <uuid>13977575-a28b-46da-8d40-b3cfe74f6c6f</uuid>
Nov 16 19:39:18 user nova-compute[86931]:   <name>instance-00000024</name>
Nov 16 19:39:18 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:39:18 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:39:18 user nova-compute[86931]:   <metadata>
Nov 16 19:39:18 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:39:18 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:39:18 user nova-compute[86931]:       <nova:name>tempest-TestVolumeBootPattern-server-1136583056</nova:name>
Nov 16 19:39:18 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:39:17</nova:creationTime>
Nov 16 19:39:18 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:39:18 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:39:18 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:39:18 user nova-compute[86931]:       <nova:owner>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:user uuid="c4267a07b6ed4016a246e2eca5a019f6">tempest-TestVolumeBootPattern-1009954453-project-member</nova:user>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:project uuid="4ae1bbd144fb4a83988126b487c7874c">tempest-TestVolumeBootPattern-1009954453</nova:project>
Nov 16 19:39:18 user nova-compute[86931]:       </nova:owner>
Nov 16 19:39:18 user nova-compute[86931]:       <nova:ports>
Nov 16 19:39:18 user nova-compute[86931]:         <nova:port uuid="a064a247-357e-40f3-95d1-1188e82b8e4b">
Nov 16 19:39:18 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:39:18 user nova-compute[86931]:         </nova:port>
Nov 16 19:39:18 user nova-compute[86931]:       </nova:ports>
Nov 16 19:39:18 user nova-compute[86931]:     </nova:instance>
Nov 16 19:39:18 user nova-compute[86931]:   </metadata>
Nov 16 19:39:18 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:39:18 user nova-compute[86931]:     <system>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="serial">13977575-a28b-46da-8d40-b3cfe74f6c6f</entry>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="uuid">13977575-a28b-46da-8d40-b3cfe74f6c6f</entry>
Nov 16 19:39:18 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:39:18 user nova-compute[86931]:     </system>
Nov 16 19:39:18 user nova-compute[86931]:   </sysinfo>
Nov 16 19:39:18 user nova-compute[86931]:   <os>
Nov 16 19:39:18 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:39:18 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:39:18 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:39:18 user nova-compute[86931]:   </os>
Nov 16 19:39:18 user nova-compute[86931]:   <features>
Nov 16 19:39:18 user nova-compute[86931]:     <acpi/>
Nov 16 19:39:18 user nova-compute[86931]:     <apic/>
Nov 16 19:39:18 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:39:18 user nova-compute[86931]:   </features>
Nov 16 19:39:18 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:39:18 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:39:18 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:39:18 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:39:18 user nova-compute[86931]:   </clock>
Nov 16 19:39:18 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:39:18 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:39:18 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:39:18 user nova-compute[86931]:   </cpu>
Nov 16 19:39:18 user nova-compute[86931]:   <devices>
Nov 16 19:39:18 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:39:18 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:39:18 user nova-compute[86931]:       <source dev="/dev/sdf"/>
Nov 16 19:39:18 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:39:18 user nova-compute[86931]:       <serial>5005ad20-d8ea-49e6-8f64-f69c00b09ff1</serial>
Nov 16 19:39:18 user nova-compute[86931]:     </disk>
Nov 16 19:39:18 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:39:18 user nova-compute[86931]:       <mac address="fa:16:3e:1f:5a:5b"/>
Nov 16 19:39:18 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:39:18 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:39:18 user nova-compute[86931]:       <target dev="tapa064a247-35"/>
Nov 16 19:39:18 user nova-compute[86931]:     </interface>
Nov 16 19:39:18 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:39:18 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/13977575-a28b-46da-8d40-b3cfe74f6c6f/console.log" append="off"/>
Nov 16 19:39:18 user nova-compute[86931]:     </serial>
Nov 16 19:39:18 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:39:18 user nova-compute[86931]:     <video>
Nov 16 19:39:18 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:39:18 user nova-compute[86931]:     </video>
Nov 16 19:39:18 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:39:18 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:39:18 user nova-compute[86931]:     </rng>
Nov 16 19:39:18 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:39:18 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:39:18 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:39:18 user nova-compute[86931]:     </memballoon>
Nov 16 19:39:18 user nova-compute[86931]:   </devices>
Nov 16 19:39:18 user nova-compute[86931]: </domain>
Nov 16 19:39:18 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136583056',display_name='tempest-TestVolumeBootPattern-server-1136583056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136583056',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-t4b9907w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:39:12Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=13977575-a28b-46da-8d40-b3cfe74f6c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG os_vif [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '867eea0e-bd2b-5e27-848c-b269ce0beba0', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa064a247-35, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa064a247-35, col_values=(('qos', UUID('d88d9f5a-414b-4303-8072-e62e0ff8217f')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa064a247-35, col_values=(('external_ids', {'iface-id': 'a064a247-357e-40f3-95d1-1188e82b8e4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:5a:5b', 'vm-uuid': '13977575-a28b-46da-8d40-b3cfe74f6c6f'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:18 user nova-compute[86931]: INFO os_vif [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35')
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:39:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] No VIF found with MAC fa:16:3e:1f:5a:5b, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] No waiting events found dispatching network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:19 user nova-compute[86931]: WARNING nova.compute.manager [req-48a9cd6b-8971-4f30-8d69-b7775a2e9702 req-b5d72288-f74f-44aa-a168-021045f12fc6 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received unexpected event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b for instance with vm_state building and task_state spawning.
Nov 16 19:39:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:39:21 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Instance spawned successfully.
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] No waiting events found dispatching network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:22 user nova-compute[86931]: WARNING nova.compute.manager [req-865b5563-4b31-4ccb-ae45-5efa83a7c074 req-38a2d467-dab8-4f21-a997-dd161e2defcf service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received unexpected event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b for instance with vm_state building and task_state spawning.
Nov 16 19:39:22 user nova-compute[86931]: INFO nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 16 19:39:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:39:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:22 user nova-compute[86931]: INFO nova.compute.manager [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Took 10.95 seconds to build instance.
Nov 16 19:39:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-18152cf9-19b5-462e-91fb-4b766c307dc3 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.059s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-changed-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Refreshing instance network info cache due to event network-changed-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] Acquiring lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] Acquired lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Refreshing network info cache for port ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:41 user nova-compute[86931]: INFO nova.compute.manager [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Terminating instance
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updated VIF entry in instance network info cache for port ba2ef801-7116-4fc8-bbc6-70ac82ec3db2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updating instance_info_cache with network_info: [{"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ccb55527-9207-4309-8550-375327c3fef0 req-80b7dc4f-bce3-4149-9ebe-90b0d856159e service nova] Releasing lock "refresh_cache-047cc254-2067-4e86-aee7-df4a3c79bc7f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-unplugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] No waiting events found dispatching network-vif-unplugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-97b0e511-89ad-43e0-9bf8-e2a60649c10b req-025e8c35-acb2-4539-b8fa-bebc45de4463 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-unplugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.compute.manager [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Terminating instance
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Instance destroyed successfully.
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'resources' on Instance uuid 047cc254-2067-4e86-aee7-df4a3c79bc7f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1052603362',display_name='tempest-AttachVolumeNegativeTest-server-1052603362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1052603362',id=35,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKPFZdIarWOUaMrfRnTY+vdLAKR8teKnAtlK5shT8/TuwMGlr8bxTSYHKV99rkUDxMuq46GYjv5KiD39WyM9F6jPL9/ZGJtWPAUYLYLoybi8u1BTsrLoFjpJcAamnUPHw==',key_name='tempest-keypair-1287209983',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:37:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-w2p2dgi5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=047cc254-2067-4e86-aee7-df4a3c79bc7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "address": "fa:16:3e:4e:ba:09", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2ef801-71", "ovs_interfaceid": "ba2ef801-7116-4fc8-bbc6-70ac82ec3db2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG os_vif [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba2ef801-71, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98c14c9d-be62-477f-ad5c-0a94a945a5da) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: INFO os_vif [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ba:09,bridge_name='br-int',has_traffic_filtering=True,id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2ef801-71')
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Deleting instance files /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f_del
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Deletion of /opt/stack/data/nova/instances/047cc254-2067-4e86-aee7-df4a3c79bc7f_del complete
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.compute.manager [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Instance destroyed successfully.
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lazy-loading 'resources' on Instance uuid 3312eed6-2405-4741-9e3a-d847ceb52be6 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1326498883',display_name='tempest-VolumesActionsTest-instance-1326498883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1326498883',id=34,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:37:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3c2c364a21e43beac3f5cdded63caa1',ramdisk_id='',reservation_id='r-gf2xdswf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1763718822',owner_user_name='tempest-VolumesActionsTest-1763718822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:37:56Z,user_data=None,user_id='3cb60c70a2614868bc72b1748e15e9af',uuid=3312eed6-2405-4741-9e3a-d847ceb52be6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converting VIF {"id": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "address": "fa:16:3e:58:64:c8", "network": {"id": "e9a3c292-6156-4a18-9cc6-539014e98a70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-252997620-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3c2c364a21e43beac3f5cdded63caa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac561b1-f1", "ovs_interfaceid": "eac561b1-f13c-4fb9-90de-f07f7554c9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG os_vif [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac561b1-f1, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cbc878c-7eb6-4b36-9088-0151e76e9bb3) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:42 user nova-compute[86931]: INFO os_vif [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:64:c8,bridge_name='br-int',has_traffic_filtering=True,id=eac561b1-f13c-4fb9-90de-f07f7554c9c6,network=Network(e9a3c292-6156-4a18-9cc6-539014e98a70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac561b1-f1')
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Deleting instance files /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6_del
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Deletion of /opt/stack/data/nova/instances/3312eed6-2405-4741-9e3a-d847ceb52be6_del complete
Nov 16 19:39:42 user nova-compute[86931]: INFO nova.compute.manager [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 19:39:42 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:39:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:43 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Took 0.81 seconds to deallocate network for instance.
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a5f6bd0-4ff4-4f8f-b28e-1c0b16e9becb req-23372cf4-6d1f-4cad-8f42-5ff01a0fcd32 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-deleted-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:43 user nova-compute[86931]: INFO nova.compute.manager [req-3a5f6bd0-4ff4-4f8f-b28e-1c0b16e9becb req-23372cf4-6d1f-4cad-8f42-5ff01a0fcd32 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Neutron deleted interface ba2ef801-7116-4fc8-bbc6-70ac82ec3db2; detaching it from the instance and deleting it from the info cache
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.network.neutron [req-3a5f6bd0-4ff4-4f8f-b28e-1c0b16e9becb req-23372cf4-6d1f-4cad-8f42-5ff01a0fcd32 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-3a5f6bd0-4ff4-4f8f-b28e-1c0b16e9becb req-23372cf4-6d1f-4cad-8f42-5ff01a0fcd32 service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Detach interface failed, port_id=ba2ef801-7116-4fc8-bbc6-70ac82ec3db2, reason: Instance 047cc254-2067-4e86-aee7-df4a3c79bc7f could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-unplugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] No waiting events found dispatching network-vif-unplugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-unplugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Acquiring lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] No waiting events found dispatching network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:43 user nova-compute[86931]: WARNING nova.compute.manager [req-8d25ecd3-afdf-470a-83e4-e291694be4a9 req-0ae91b08-46be-4bcb-aaff-d4bb7fe0df33 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received unexpected event network-vif-plugged-eac561b1-f13c-4fb9-90de-f07f7554c9c6 for instance with vm_state active and task_state deleting.
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:43 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Took 0.53 seconds to deallocate network for instance.
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:43 user nova-compute[86931]: INFO nova.compute.manager [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Terminating instance
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.manager [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.390s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:43 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Deleted allocations for instance 047cc254-2067-4e86-aee7-df4a3c79bc7f
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] Acquiring lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] No waiting events found dispatching network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:44 user nova-compute[86931]: WARNING nova.compute.manager [req-530b6bcc-2a23-44e7-ab48-fd64e1eee5ee req-16e9b414-34d3-4089-ac64-9c527167b17b service nova] [instance: 047cc254-2067-4e86-aee7-df4a3c79bc7f] Received unexpected event network-vif-plugged-ba2ef801-7116-4fc8-bbc6-70ac82ec3db2 for instance with vm_state deleted and task_state None.
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Instance destroyed successfully.
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid f8e118ca-5ace-4f2f-964d-9e9638950d00 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0df06509-33ef-49ce-a8ea-393fb03be2d9 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "047cc254-2067-4e86-aee7-df4a3c79bc7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1287445306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1287445306',id=22,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-amzmcm5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:32:18Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=f8e118ca-5ace-4f2f-964d-9e9638950d00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "568223df-c056-419d-8444-8dbab484fed3", "address": "fa:16:3e:a8:d6:f9", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap568223df-c0", "ovs_interfaceid": "568223df-c056-419d-8444-8dbab484fed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG os_vif [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap568223df-c0, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc335a4-3295-436f-9e30-51cab14ccfc4) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:44 user nova-compute[86931]: INFO os_vif [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:d6:f9,bridge_name='br-int',has_traffic_filtering=True,id=568223df-c056-419d-8444-8dbab484fed3,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap568223df-c0')
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Deleting instance files /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00_del
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Deletion of /opt/stack/data/nova/instances/f8e118ca-5ace-4f2f-964d-9e9638950d00_del complete
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.compute.manager [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Deleted allocations for instance 3312eed6-2405-4741-9e3a-d847ceb52be6
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-9176ff62-411e-4886-b74f-36b8071ceb4f tempest-VolumesActionsTest-1763718822 tempest-VolumesActionsTest-1763718822-project-member] Lock "3312eed6-2405-4741-9e3a-d847ceb52be6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:44 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Took 0.48 seconds to deallocate network for instance.
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:45 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Deleted allocations for instance f8e118ca-5ace-4f2f-964d-9e9638950d00
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-45f6b531-1da8-4c37-b787-7e83513df5f6 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: 3312eed6-2405-4741-9e3a-d847ceb52be6] Received event network-vif-deleted-eac561b1-f13c-4fb9-90de-f07f7554c9c6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-vif-unplugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] No waiting events found dispatching network-vif-unplugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:45 user nova-compute[86931]: WARNING nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received unexpected event network-vif-unplugged-568223df-c056-419d-8444-8dbab484fed3 for instance with vm_state deleted and task_state None.
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Acquiring lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] Lock "f8e118ca-5ace-4f2f-964d-9e9638950d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] No waiting events found dispatching network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:45 user nova-compute[86931]: WARNING nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received unexpected event network-vif-plugged-568223df-c056-419d-8444-8dbab484fed3 for instance with vm_state deleted and task_state None.
Nov 16 19:39:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-15c3a727-69e4-480d-8b6f-8cad79ccbf52 req-50b815de-0630-4307-b5b0-ea979ae3e708 service nova] [instance: f8e118ca-5ace-4f2f-964d-9e9638950d00] Received event network-vif-deleted-568223df-c056-419d-8444-8dbab484fed3 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:46 user nova-compute[86931]: INFO nova.compute.manager [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Terminating instance
Nov 16 19:39:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-6da8c54c-9d07-4b57-a135-95936f51f24c req-d9c4a38f-e97d-44b6-abab-41578743c34d service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-unplugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Instance destroyed successfully.
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'resources' on Instance uuid 105dd9f1-9f20-4f05-8dd4-ad360886dc09 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-105731436',display_name='tempest-ServerActionsTestOtherA-server-105731436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-105731436',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:35:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-8zvnzf56',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=105dd9f1-9f20-4f05-8dd4-ad360886dc09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "address": "fa:16:3e:3d:3a:76", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5418fbbb-80", "ovs_interfaceid": "5418fbbb-8075-4eca-85f9-5a551f788b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_vif [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5418fbbb-80, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9daf398f-0199-4801-b6b9-353e9b141c27) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:39:47 user nova-compute[86931]: INFO os_vif [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=5418fbbb-8075-4eca-85f9-5a551f788b8c,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5418fbbb-80')
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utyxqFhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:39:47 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34a45e-c897-4bbb-bb23-d0cfacf83ebf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:39:47 user nova-compute[86931]: No targets found.
Nov 16 19:39:47 user nova-compute[86931]: iSNS:
Nov 16 19:39:47 user nova-compute[86931]: No targets found.
Nov 16 19:39:47 user nova-compute[86931]: STATIC:
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:39:47 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:39:47 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:39:47 user nova-compute[86931]: FIRMWARE:
Nov 16 19:39:47 user nova-compute[86931]: No targets found.
Nov 16 19:39:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:39:47 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:39:47 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fe2ff2-b958-4cbe-95c8-3ee6d5db4611]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[01347d02-37f3-49b4-8e77-0d4b94c2457d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:39:47 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:39:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5ec4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2773f8-4a0e-410d-9883-217cce444c4a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[146cf8f1-9905-41fd-9a59-b7f6d137aeb2]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e496c2c-2c8e-49e9-9713-657cd6784f68]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf400f-e22f-4d02-b3c3-847547aadb5f]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23535656266353465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d1a8ba48', '/dev/disk/by-id/scsi-1SCST_BIOd1a8ba48-55ebf54e8d876c28') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ebf470-e481-4395-a702-f6d83851c018]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada4284-d523-43a6-8b8c-f579bdc1e246]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dda96f2-158a-4d39-8b0f-50081b4b5b89]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260]
Nov 16 19:39:47 user nova-compute[86931]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989, portal: 172.16.0.220,3260] successful.
Nov 16 19:39:47 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b776c46-7cd7-4ceb-ba82-46f23fdd9989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1806c4-eb96-4faa-aefc-c7c1a0a3389d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] <== disconnect_volume: return (338ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:39:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Deleting instance files /opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09_del
Nov 16 19:39:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Deletion of /opt/stack/data/nova/instances/105dd9f1-9f20-4f05-8dd4-ad360886dc09_del complete
Nov 16 19:39:47 user nova-compute[86931]: INFO nova.compute.manager [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 16 19:39:47 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:39:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Took 0.64 seconds to deallocate network for instance.
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-82eca2e5-2407-49b0-8dd3-3878f0d38be4 req-0917c8c6-9914-45c5-8fa2-169353452c9c service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-deleted-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:48 user nova-compute[86931]: INFO nova.compute.manager [req-82eca2e5-2407-49b0-8dd3-3878f0d38be4 req-0917c8c6-9914-45c5-8fa2-169353452c9c service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Neutron deleted interface 5418fbbb-8075-4eca-85f9-5a551f788b8c; detaching it from the instance and deleting it from the info cache
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-82eca2e5-2407-49b0-8dd3-3878f0d38be4 req-0917c8c6-9914-45c5-8fa2-169353452c9c service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-82eca2e5-2407-49b0-8dd3-3878f0d38be4 req-0917c8c6-9914-45c5-8fa2-169353452c9c service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Detach interface failed, port_id=5418fbbb-8075-4eca-85f9-5a551f788b8c, reason: Instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] Acquiring lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] No waiting events found dispatching network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:39:48 user nova-compute[86931]: WARNING nova.compute.manager [req-b85b3c66-6bea-496b-8b6b-7856ebf4df39 req-91f44e84-4b38-4fef-838a-426b8e6ac0a0 service nova] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Received unexpected event network-vif-plugged-5418fbbb-8075-4eca-85f9-5a551f788b8c for instance with vm_state active and task_state deleting.
Nov 16 19:39:49 user nova-compute[86931]: INFO nova.compute.manager [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Took 0.83 seconds to detach 1 volumes for instance.
Nov 16 19:39:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 105dd9f1-9f20-4f05-8dd4-ad360886dc09] Deleting volume: 7b776c46-7cd7-4ceb-ba82-46f23fdd9989 {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:49 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Deleted allocations for instance 105dd9f1-9f20-4f05-8dd4-ad360886dc09
Nov 16 19:39:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5562edc4-2d0b-4133-a03c-a40a2adcd786 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "105dd9f1-9f20-4f05-8dd4-ad360886dc09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:39:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:39:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.161884307861328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 04ec3edd-f329-47d3-84df-85343c9b4336 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a29e474f-1d9d-49e8-bccb-b252d7168ab1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 13977575-a28b-46da-8d40-b3cfe74f6c6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:39:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:39:54 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:39:54 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:39:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:39:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:39:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:39:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:39:55 user nova-compute[86931]: INFO nova.compute.manager [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Detaching volume 729dde0f-e35c-49bc-8fcb-244e1ab4316a
Nov 16 19:39:56 user nova-compute[86931]: INFO nova.virt.block_device [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Attempting to driver detach volume 729dde0f-e35c-49bc-8fcb-244e1ab4316a from mountpoint /dev/vdc
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Attempting to detach device vdc from instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:39:56 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:39:56 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:39:56 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:39:56 user nova-compute[86931]:   <serial>729dde0f-e35c-49bc-8fcb-244e1ab4316a</serial>
Nov 16 19:39:56 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:39:56 user nova-compute[86931]: </disk>
Nov 16 19:39:56 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:39:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully detached device vdc from instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 from the persistent domain config.
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:39:56 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:39:56 user nova-compute[86931]:   <source dev="/dev/sdg"/>
Nov 16 19:39:56 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:39:56 user nova-compute[86931]:   <serial>729dde0f-e35c-49bc-8fcb-244e1ab4316a</serial>
Nov 16 19:39:56 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:39:56 user nova-compute[86931]: </disk>
Nov 16 19:39:56 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [{"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:39:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:39:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:39:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:40:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 is timed out.
Nov 16 19:40:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully detached device vdc from instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 from the live domain config.
Nov 16 19:40:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tBXYMrxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:40:16 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5383a0c-baaf-4612-8f3e-1cbc2171bae2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:40:16 user nova-compute[86931]: No targets found.
Nov 16 19:40:16 user nova-compute[86931]: iSNS:
Nov 16 19:40:16 user nova-compute[86931]: No targets found.
Nov 16 19:40:16 user nova-compute[86931]: STATIC:
Nov 16 19:40:16 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1
Nov 16 19:40:16 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:16 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:16 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a
Nov 16 19:40:16 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:16 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:16 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:40:16 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:16 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:16 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:40:16 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:16 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:16 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:40:16 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:16 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:16 user nova-compute[86931]: FIRMWARE:
Nov 16 19:40:16 user nova-compute[86931]: No targets found.
Nov 16 19:40:16 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:40:16 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:40:16 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a67d99-cfe4-4e17-bd7d-acbc4d5e572a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4187c9e-a4e7-4f2f-a0f7-83cdc55af1e5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a (non-flash)
Nov 16 19:40:16 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:16 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c1825f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a'): ({'sdg'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Removing single pathed devices sdg {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f343abb-7040-49a7-999d-b8854852fa99]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[89914643-4d54-4ce1-93d4-16c9c2c2c89d]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flushing IO for device /dev/sdg {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb5abe5-3b91-4b60-9a6e-9aa2090e24be]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896ff9b-fe64-4837-9f3f-756f0d3a4011]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] SCSI volumes sdg have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7743c44-2c71-4db6-b096-574241285448]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f3b95-50f6-447d-85e0-98ab5eb0c53f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260]
Nov 16 19:40:16 user nova-compute[86931]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a, portal: 172.16.0.220,3260] successful.
Nov 16 19:40:16 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:729dde0f-e35c-49bc-8fcb-244e1ab4316a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5e82c-a33b-487d-a125-b556fb02df2a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] <== disconnect_volume: return (284ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:40:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:40:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:17 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'flavor' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e420e587-0e6f-45ff-84ba-2892378f468e tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:33 user nova-compute[86931]: INFO nova.compute.manager [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Detaching volume 3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:40:33 user nova-compute[86931]: INFO nova.virt.block_device [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Attempting to driver detach volume 3109c511-d67f-4091-8dd7-2a1203f2c648 from mountpoint /dev/vdb
Nov 16 19:40:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Attempting to detach device vdb from instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:40:33 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:40:33 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:40:33 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:40:33 user nova-compute[86931]:   <serial>3109c511-d67f-4091-8dd7-2a1203f2c648</serial>
Nov 16 19:40:33 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:40:33 user nova-compute[86931]: </disk>
Nov 16 19:40:33 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:40:33 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d from the persistent domain config.
Nov 16 19:40:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:40:33 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:40:33 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:40:33 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:40:33 user nova-compute[86931]:   <serial>3109c511-d67f-4091-8dd7-2a1203f2c648</serial>
Nov 16 19:40:33 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:40:33 user nova-compute[86931]: </disk>
Nov 16 19:40:33 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:40:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:34 user nova-compute[86931]: INFO nova.compute.manager [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Terminating instance
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-0037635a-9db0-45d4-b0f6-fae44d4355ed req-191b3c08-2658-463c-a269-c2cb730e86d2 service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-unplugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Instance destroyed successfully.
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid 04ec3edd-f329-47d3-84df-85343c9b4336 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-39047473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-39047473',id=12,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-j1i0hpw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:28:34Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=04ec3edd-f329-47d3-84df-85343c9b4336,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "address": "fa:16:3e:7f:a2:09", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape07d532f-68", "ovs_interfaceid": "e07d532f-681d-4ea2-b9b3-88bc2e3acbeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_vif [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape07d532f-68, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd6ff4fc-a19d-436e-9679-915c2877cef1) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:34 user nova-compute[86931]: INFO os_vif [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a2:09,bridge_name='br-int',has_traffic_filtering=True,id=e07d532f-681d-4ea2-b9b3-88bc2e3acbeb,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape07d532f-68')
Nov 16 19:40:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzyOTjYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:40:34 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3162c34b-7819-4af7-822f-17c77bb90f1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:40:34 user nova-compute[86931]: No targets found.
Nov 16 19:40:34 user nova-compute[86931]: iSNS:
Nov 16 19:40:34 user nova-compute[86931]: No targets found.
Nov 16 19:40:34 user nova-compute[86931]: STATIC:
Nov 16 19:40:34 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1
Nov 16 19:40:34 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:34 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:34 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051
Nov 16 19:40:34 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:34 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:34 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:40:34 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:34 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:34 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:40:34 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:34 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:34 user nova-compute[86931]: FIRMWARE:
Nov 16 19:40:34 user nova-compute[86931]: No targets found.
Nov 16 19:40:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:40:34 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:40:34 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[714ac855-b8c8-4ee9-8d3c-0babfd6649f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86787be5-5ec6-4961-9b17-9fda38a04047]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:34 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c557760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[562313a5-5a01-427a-9da0-7081ec406ed1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c91813-7e31-4c36-b484-03ede1262e3c]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5b51c-4c1f-4c13-92fc-fbfd05e425b2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:40:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1cda79-2b45-43be-ba18-b775cfed78d8]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7a5ad0-5d0a-493a-9fc2-d3e27499e971]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ce264-5cc4-4991-8a12-7fbcd9a7e30e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260]
Nov 16 19:40:35 user nova-compute[86931]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051, portal: 172.16.0.220,3260] successful.
Nov 16 19:40:35 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58534ea8-5a28-42c9-ac38-8616c8402051 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd2dc8-0866-49dd-bb0d-34623f9abab2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] <== disconnect_volume: return (334ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:40:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Deleting instance files /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336_del
Nov 16 19:40:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Deletion of /opt/stack/data/nova/instances/04ec3edd-f329-47d3-84df-85343c9b4336_del complete
Nov 16 19:40:35 user nova-compute[86931]: INFO nova.compute.manager [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 19:40:35 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:40:35 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:40:35 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Took 0.44 seconds to deallocate network for instance.
Nov 16 19:40:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-6599d0ba-438f-4f10-9c3b-6129bea1b497 req-8610f7a1-5756-47d0-9ed4-4af88851940c service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-deleted-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] Acquiring lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] Lock "04ec3edd-f329-47d3-84df-85343c9b4336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] No waiting events found dispatching network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:36 user nova-compute[86931]: WARNING nova.compute.manager [req-626edf01-c3e7-4994-86bf-70b5e270b020 req-2d2b7ce5-43ac-4c5c-8242-a78b480ec92f service nova] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Received unexpected event network-vif-plugged-e07d532f-681d-4ea2-b9b3-88bc2e3acbeb for instance with vm_state active and task_state deleting.
Nov 16 19:40:36 user nova-compute[86931]: INFO nova.compute.manager [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: 04ec3edd-f329-47d3-84df-85343c9b4336] Took 0.74 seconds to detach 1 volumes for instance.
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:36 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Deleted allocations for instance 04ec3edd-f329-47d3-84df-85343c9b4336
Nov 16 19:40:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eaefb9dd-f7c2-44f5-badf-7327e3084eb8 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "04ec3edd-f329-47d3-84df-85343c9b4336" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:38 user nova-compute[86931]: INFO nova.compute.manager [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Rescuing
Nov 16 19:40:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:40:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:40:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.network.neutron [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:39 user nova-compute[86931]: WARNING nova.compute.manager [req-59fc17a6-3261-465c-ba23-0b370c7c5629 req-ba93d85d-4fa1-4dc2-ac56-5ac3ddb518e9 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state active and task_state rescuing.
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance destroyed successfully.
Nov 16 19:40:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Attempting rescue
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:40:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Creating image(s)
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue" returned: 0 in 0.047s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'migration_context' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.base [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<433ab086-b0a1-44d9-9840-9696ca7cfca2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start _get_guest_xml network_info=[{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:e5:41:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.base [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<433ab086-b0a1-44d9-9840-9696ca7cfca2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'numa_topology' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.base [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<433ab086-b0a1-44d9-9840-9696ca7cfca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:40:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:40:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.base [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<433ab086-b0a1-44d9-9840-9696ca7cfca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941676357',display_name='tempest-ServerRescueNegativeTestJSON-server-1941676357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941676357',id=31,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-z84ou6tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:36:02Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=433ab086-b0a1-44d9-9840-9696ca7cfca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:e5:41:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:e5:41:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.objects.base [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<433ab086-b0a1-44d9-9840-9696ca7cfca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:40:40 user nova-compute[86931]:   <uuid>433ab086-b0a1-44d9-9840-9696ca7cfca2</uuid>
Nov 16 19:40:40 user nova-compute[86931]:   <name>instance-0000001f</name>
Nov 16 19:40:40 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:40:40 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:40:40 user nova-compute[86931]:   <metadata>
Nov 16 19:40:40 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:40:40 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1941676357</nova:name>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:40:40</nova:creationTime>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:40:40 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:40:40 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:owner>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:40:40 user nova-compute[86931]:       </nova:owner>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:40:40 user nova-compute[86931]:       <nova:ports>
Nov 16 19:40:40 user nova-compute[86931]:         <nova:port uuid="5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e">
Nov 16 19:40:40 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:40:40 user nova-compute[86931]:         </nova:port>
Nov 16 19:40:40 user nova-compute[86931]:       </nova:ports>
Nov 16 19:40:40 user nova-compute[86931]:     </nova:instance>
Nov 16 19:40:40 user nova-compute[86931]:   </metadata>
Nov 16 19:40:40 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:40:40 user nova-compute[86931]:     <system>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="serial">433ab086-b0a1-44d9-9840-9696ca7cfca2</entry>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="uuid">433ab086-b0a1-44d9-9840-9696ca7cfca2</entry>
Nov 16 19:40:40 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:40:40 user nova-compute[86931]:     </system>
Nov 16 19:40:40 user nova-compute[86931]:   </sysinfo>
Nov 16 19:40:40 user nova-compute[86931]:   <os>
Nov 16 19:40:40 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:40:40 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:40:40 user nova-compute[86931]:   </os>
Nov 16 19:40:40 user nova-compute[86931]:   <features>
Nov 16 19:40:40 user nova-compute[86931]:     <acpi/>
Nov 16 19:40:40 user nova-compute[86931]:     <apic/>
Nov 16 19:40:40 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:40:40 user nova-compute[86931]:   </features>
Nov 16 19:40:40 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:40:40 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:40:40 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:40:40 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:40:40 user nova-compute[86931]:   </clock>
Nov 16 19:40:40 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:40:40 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:40:40 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:40:40 user nova-compute[86931]:   </cpu>
Nov 16 19:40:40 user nova-compute[86931]:   <devices>
Nov 16 19:40:40 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:40:40 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:40:40 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue"/>
Nov 16 19:40:40 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:40:40 user nova-compute[86931]:     </disk>
Nov 16 19:40:40 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:40:40 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:40:40 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk"/>
Nov 16 19:40:40 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:40:40 user nova-compute[86931]:     </disk>
Nov 16 19:40:40 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:40:40 user nova-compute[86931]:       <mac address="fa:16:3e:e5:41:11"/>
Nov 16 19:40:40 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:40:40 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:40:40 user nova-compute[86931]:       <target dev="tap5d417b2f-c2"/>
Nov 16 19:40:40 user nova-compute[86931]:     </interface>
Nov 16 19:40:40 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:40:40 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/console.log" append="off"/>
Nov 16 19:40:40 user nova-compute[86931]:     </serial>
Nov 16 19:40:40 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:40:40 user nova-compute[86931]:     <video>
Nov 16 19:40:40 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:40:40 user nova-compute[86931]:     </video>
Nov 16 19:40:40 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:40:40 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:40:40 user nova-compute[86931]:     </rng>
Nov 16 19:40:40 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:40:40 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:40:40 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:40:40 user nova-compute[86931]:     </memballoon>
Nov 16 19:40:40 user nova-compute[86931]:   </devices>
Nov 16 19:40:40 user nova-compute[86931]: </domain>
Nov 16 19:40:40 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:40:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance destroyed successfully.
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:e5:41:11, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:40 user nova-compute[86931]: INFO nova.compute.manager [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Terminating instance
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-93b5ed51-52bb-4f41-b4b4-f8d169fcf482 req-150aa0f2-d6e1-4eb2-9e65-980960e57906 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:41 user nova-compute[86931]: WARNING nova.compute.manager [req-f6f6580f-f72b-4075-b2fe-919d98e78be8 req-2ca789b6-6b44-462a-8497-70f6a4784cdb service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state active and task_state rescuing.
Nov 16 19:40:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Instance destroyed successfully.
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lazy-loading 'resources' on Instance uuid 8d74eef2-f3a7-4063-95a5-4f13304c9d8f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230297822',display_name='tempest-ServerActionsTestOtherA-server-230297822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230297822',id=3,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzvkpsv+QVccaChCm7/QNjtNmntIj8E7B4lAYVt5U7VFWfnZ/sTIQnYCwzmAOuAvgiIwD9cRTBF38PyRgFFo5C+bxaN0bUeGmRDizUZy0CzmTFF1oo85wf+u0iAWmdvXw==',key_name='tempest-keypair-352294224',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='823d93d9aed54ef0aac913d3707f207f',ramdisk_id='',reservation_id='r-vfohyurd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-672558396',owner_user_name='tempest-ServerActionsTestOtherA-672558396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c74086febf834740bbe6d094ebad864b',uuid=8d74eef2-f3a7-4063-95a5-4f13304c9d8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converting VIF {"id": "98c5d767-24e5-4f04-983e-d217b97d29e6", "address": "fa:16:3e:8f:ac:60", "network": {"id": "de9cadf0-765d-4e41-a8df-10d8e1d7550c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1529572332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "823d93d9aed54ef0aac913d3707f207f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98c5d767-24", "ovs_interfaceid": "98c5d767-24e5-4f04-983e-d217b97d29e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG os_vif [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98c5d767-24, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=197ac624-74c8-4ba2-8664-848fee4afcde) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: INFO os_vif [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:ac:60,bridge_name='br-int',has_traffic_filtering=True,id=98c5d767-24e5-4f04-983e-d217b97d29e6,network=Network(de9cadf0-765d-4e41-a8df-10d8e1d7550c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98c5d767-24')
Nov 16 19:40:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Deleting instance files /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f_del
Nov 16 19:40:41 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Deletion of /opt/stack/data/nova/instances/8d74eef2-f3a7-4063-95a5-4f13304c9d8f_del complete
Nov 16 19:40:41 user nova-compute[86931]: INFO nova.compute.manager [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 16 19:40:41 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:40:42 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Took 0.56 seconds to deallocate network for instance.
Nov 16 19:40:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Deleted allocations for instance 8d74eef2-f3a7-4063-95a5-4f13304c9d8f
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-23f11d36-2054-4dac-9edd-ea887f688825 tempest-ServerActionsTestOtherA-672558396 tempest-ServerActionsTestOtherA-672558396-project-member] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.336s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:42 user nova-compute[86931]: WARNING nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state deleted and task_state None.
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:42 user nova-compute[86931]: WARNING nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state deleted and task_state None.
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:42 user nova-compute[86931]: WARNING nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state deleted and task_state None.
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:42 user nova-compute[86931]: WARNING nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-unplugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state deleted and task_state None.
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Acquiring lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] Lock "8d74eef2-f3a7-4063-95a5-4f13304c9d8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] No waiting events found dispatching network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:42 user nova-compute[86931]: WARNING nova.compute.manager [req-bcbefea1-ab25-496c-be6c-9880c1dbda66 req-40c0c9f0-4a4b-4c33-b13f-3dc401769ef6 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received unexpected event network-vif-plugged-98c5d767-24e5-4f04-983e-d217b97d29e6 for instance with vm_state deleted and task_state None.
Nov 16 19:40:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:43 user nova-compute[86931]: WARNING nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state active and task_state rescuing.
Nov 16 19:40:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 8d74eef2-f3a7-4063-95a5-4f13304c9d8f] Received event network-vif-deleted-98c5d767-24e5-4f04-983e-d217b97d29e6 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:43 user nova-compute[86931]: WARNING nova.compute.manager [req-25951739-23bd-42de-a1ee-b0e4149a763b req-b09cd61f-07ed-4e25-975c-2475ae9aee95 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state active and task_state rescuing.
Nov 16 19:40:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-119bf5a1-506e-4c50-880e-4b9bce7c6fcc tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:46 user nova-compute[86931]: INFO nova.compute.manager [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Terminating instance
Nov 16 19:40:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-1155eb0a-e441-4c08-b7b1-c9e4db612276 req-91f75676-6b87-49b4-baa2-0263498ebef3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Instance destroyed successfully.
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'resources' on Instance uuid 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-616727702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-616727702',id=28,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN62Tm2hkJO31mI8sKVjFAW7p+2HWIdVslzjEy3GpvN6Tv7YWvSCXbf5V+LnWm5SBYycrbysIWt/FO8SusP23pjycJCubr71x/+WOIsrEgWT/LQ+W1Du4Z7Bwzy0lNl9aw==',key_name='tempest-keypair-2010505057',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-bxk4iwon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "address": "fa:16:3e:9b:c8:50", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb06d9c28-33", "ovs_interfaceid": "b06d9c28-33e4-492a-9e67-a69ec3b768e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG os_vif [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb06d9c28-33, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9e96dd3-fa6e-4bc9-89e6-d738a5c32435) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: INFO os_vif [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:50,bridge_name='br-int',has_traffic_filtering=True,id=b06d9c28-33e4-492a-9e67-a69ec3b768e8,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb06d9c28-33')
Nov 16 19:40:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Deleting instance files /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0_del
Nov 16 19:40:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Deletion of /opt/stack/data/nova/instances/8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0_del complete
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: INFO nova.compute.manager [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 19:40:47 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-4e24d392-7a17-473d-9a97-2cef4b5a3bab req-25dc6ee7-9415-42a5-b8c0-970d7b50a2d9 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-deleted-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:48 user nova-compute[86931]: INFO nova.compute.manager [req-4e24d392-7a17-473d-9a97-2cef4b5a3bab req-25dc6ee7-9415-42a5-b8c0-970d7b50a2d9 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Neutron deleted interface b06d9c28-33e4-492a-9e67-a69ec3b768e8; detaching it from the instance and deleting it from the info cache
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.network.neutron [req-4e24d392-7a17-473d-9a97-2cef4b5a3bab req-25dc6ee7-9415-42a5-b8c0-970d7b50a2d9 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:40:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Took 0.87 seconds to deallocate network for instance.
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-4e24d392-7a17-473d-9a97-2cef4b5a3bab req-25dc6ee7-9415-42a5-b8c0-970d7b50a2d9 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Detach interface failed, port_id=b06d9c28-33e4-492a-9e67-a69ec3b768e8, reason: Instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Deleted allocations for instance 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-445052d8-ae70-4280-8cc2-e9d209994f48 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:48 user nova-compute[86931]: WARNING nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state deleted and task_state None.
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:48 user nova-compute[86931]: WARNING nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state deleted and task_state None.
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:48 user nova-compute[86931]: WARNING nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state deleted and task_state None.
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:48 user nova-compute[86931]: WARNING nova.compute.manager [req-087406a4-26c1-4379-a8cf-77ce796c6276 req-7a74a905-18b6-4fc1-975d-bb030a0bf7b3 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-unplugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state deleted and task_state None.
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] Acquiring lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] Lock "8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] No waiting events found dispatching network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:40:50 user nova-compute[86931]: WARNING nova.compute.manager [req-09242b27-739e-42ed-be2f-0dc9813b8afc req-ccd8840a-6dfa-45fa-a995-c40d674cc400 service nova] [instance: 8b3e7b7c-9a84-47c1-90c1-dd1ee11f9ae0] Received unexpected event network-vif-plugged-b06d9c28-33e4-492a-9e67-a69ec3b768e8 for instance with vm_state deleted and task_state None.
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:40:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:40:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8078MB free_disk=25.206844329833984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance afe35609-1004-4958-9893-d82894b6f297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a29e474f-1d9d-49e8-bccb-b252d7168ab1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 13977575-a28b-46da-8d40-b3cfe74f6c6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:40:53 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d is timed out.
Nov 16 19:40:53 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d from the live domain config.
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'shiExVvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:40:53 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2823d-c8bf-49a8-aa3a-2ee6e5250632]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:40:53 user nova-compute[86931]: No targets found.
Nov 16 19:40:53 user nova-compute[86931]: iSNS:
Nov 16 19:40:53 user nova-compute[86931]: No targets found.
Nov 16 19:40:53 user nova-compute[86931]: STATIC:
Nov 16 19:40:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1
Nov 16 19:40:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648
Nov 16 19:40:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:53 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:40:53 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:40:53 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:40:53 user nova-compute[86931]: FIRMWARE:
Nov 16 19:40:53 user nova-compute[86931]: No targets found.
Nov 16 19:40:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:40:53 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:40:53 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef162da0-c2a2-4c01-8d5e-b84c7b9e9290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c037c47-56b3-4705-960e-741b915ba1c0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:40:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c181510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d9a7d-5817-4979-8ac8-08c933a50f30]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbdef15-078a-47d1-8edb-8ab923237d7d]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8df3a-d6aa-48f6-aba5-ec454165f6bf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e4e07-ee8a-4566-82c0-f2645b52e146]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b05006b-25ff-4d26-a824-868bb3bf0ace]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b18a4-652f-4b9e-9e2a-e6e3b63199dd]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260]
Nov 16 19:40:53 user nova-compute[86931]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648, portal: 172.16.0.220,3260] successful.
Nov 16 19:40:53 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3109c511-d67f-4091-8dd7-2a1203f2c648 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c643cf-a3cb-439a-b82f-be5f5e88ee1c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== disconnect_volume: return (311ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:40:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:40:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:40:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac904f50-641e-40cd-8121-a12f4a371e07 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:40:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:40:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:40:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing instance network info cache due to event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] Acquiring lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] Acquired lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:02 user nova-compute[86931]: DEBUG nova.network.neutron [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updated VIF entry in instance network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5d9d4e31-6997-435d-a3e8-ea4dac75e420 req-bcd6b9c3-55a8-4c10-b337-c874423c07ec service nova] Releasing lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing instance network info cache due to event network-changed-a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] Acquiring lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] Acquired lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.network.neutron [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Refreshing network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:03 user nova-compute[86931]: INFO nova.compute.manager [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Terminating instance
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-unplugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] No waiting events found dispatching network-vif-unplugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-4ff37b40-df31-4b97-b5bb-c1328c6a586c req-6546b92a-c993-4b0a-9196-d7cd63824ec0 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-unplugged-a064a247-357e-40f3-95d1-1188e82b8e4b for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.network.neutron [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updated VIF entry in instance network info cache for port a064a247-357e-40f3-95d1-1188e82b8e4b. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.network.neutron [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [{"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2be368ab-a450-463a-a5fc-14fa6e0f7c6a req-3edb32f8-3e6e-408b-bbeb-b8ef9826a5b5 service nova] Releasing lock "refresh_cache-13977575-a28b-46da-8d40-b3cfe74f6c6f" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:41:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Instance destroyed successfully.
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid 13977575-a28b-46da-8d40-b3cfe74f6c6f {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1136583056',display_name='tempest-TestVolumeBootPattern-server-1136583056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1136583056',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-t4b9907w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:39:22Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=13977575-a28b-46da-8d40-b3cfe74f6c6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "a064a247-357e-40f3-95d1-1188e82b8e4b", "address": "fa:16:3e:1f:5a:5b", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa064a247-35", "ovs_interfaceid": "a064a247-357e-40f3-95d1-1188e82b8e4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_vif [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa064a247-35, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d88d9f5a-414b-4303-8072-e62e0ff8217f) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:04 user nova-compute[86931]: INFO os_vif [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:5a:5b,bridge_name='br-int',has_traffic_filtering=True,id=a064a247-357e-40f3-95d1-1188e82b8e4b,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa064a247-35')
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFRUpncu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:41:04 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7592cb5-56e6-4bb6-b8da-c688afe5e4dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:41:04 user nova-compute[86931]: No targets found.
Nov 16 19:41:04 user nova-compute[86931]: iSNS:
Nov 16 19:41:04 user nova-compute[86931]: No targets found.
Nov 16 19:41:04 user nova-compute[86931]: STATIC:
Nov 16 19:41:04 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1
Nov 16 19:41:04 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:41:04 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:41:04 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:41:04 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:41:04 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:41:04 user nova-compute[86931]: FIRMWARE:
Nov 16 19:41:04 user nova-compute[86931]: No targets found.
Nov 16 19:41:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:41:04 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:41:04 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e099b5b9-db0c-4005-8e1b-39c066216fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d2b35-ff87-4009-b1c1-7de6787a3587]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:41:04 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:41:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:41:04 user nova-compute[86931]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 (non-flash)
Nov 16 19:41:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c18b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1'): ({'sdf'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sdf {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d616b5-9824-4cc9-9b92-df9dac48882a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da009b-8e90-4b22-96d9-59f743692fe8]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sdf {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa1685e-5699-4353-83d4-d843099eb9e4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f7af54-557e-45ef-897b-6ccb40aa4b52]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sdf have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_55afbb71',) {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c970b24e-64f4-49a0-a908-3b816f23affd]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc8c808-afb0-4a37-b1de-c4efb5895c87]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff8d876-566d-4d3e-8c75-8de3298fa3e1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260]
Nov 16 19:41:04 user nova-compute[86931]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1, portal: 172.16.0.220,3260] successful.
Nov 16 19:41:04 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5005ad20-d8ea-49e6-8f64-f69c00b09ff1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[878cf3da-aa26-477f-ad1b-999d4608eeea]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (299ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:41:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Deleting instance files /opt/stack/data/nova/instances/13977575-a28b-46da-8d40-b3cfe74f6c6f_del
Nov 16 19:41:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Deletion of /opt/stack/data/nova/instances/13977575-a28b-46da-8d40-b3cfe74f6c6f_del complete
Nov 16 19:41:04 user nova-compute[86931]: INFO nova.compute.manager [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 19:41:04 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:41:04 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-3e245745-2805-46ba-8427-191d744c2a12 req-d059095a-c4b8-4bf7-b58b-f5ac02214fca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-deleted-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:05 user nova-compute[86931]: INFO nova.compute.manager [req-3e245745-2805-46ba-8427-191d744c2a12 req-d059095a-c4b8-4bf7-b58b-f5ac02214fca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Neutron deleted interface a064a247-357e-40f3-95d1-1188e82b8e4b; detaching it from the instance and deleting it from the info cache
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-3e245745-2805-46ba-8427-191d744c2a12 req-d059095a-c4b8-4bf7-b58b-f5ac02214fca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:05 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Took 0.45 seconds to deallocate network for instance.
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-3e245745-2805-46ba-8427-191d744c2a12 req-d059095a-c4b8-4bf7-b58b-f5ac02214fca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Detach interface failed, port_id=a064a247-357e-40f3-95d1-1188e82b8e4b, reason: Instance 13977575-a28b-46da-8d40-b3cfe74f6c6f could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] Acquiring lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] No waiting events found dispatching network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:05 user nova-compute[86931]: WARNING nova.compute.manager [req-9eb3d0a9-efb3-49c2-979c-a5037d2ac614 req-b2647423-2bef-4dcd-9166-f5ca5458bdca service nova] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Received unexpected event network-vif-plugged-a064a247-357e-40f3-95d1-1188e82b8e4b for instance with vm_state active and task_state deleting.
Nov 16 19:41:05 user nova-compute[86931]: INFO nova.compute.manager [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: 13977575-a28b-46da-8d40-b3cfe74f6c6f] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 19:41:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:06 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:41:06 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:41:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:06 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance 13977575-a28b-46da-8d40-b3cfe74f6c6f
Nov 16 19:41:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0371db9a-174c-4fb4-9603-15eccf5a9a59 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "13977575-a28b-46da-8d40-b3cfe74f6c6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.744s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:23 user nova-compute[86931]: INFO nova.compute.manager [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Terminating instance
Nov 16 19:41:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-unplugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] No waiting events found dispatching network-vif-unplugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-39311323-85c6-47a5-aa2d-0da153b0967f req-db4847f9-b77d-4350-9d55-f2564bb8220f service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-unplugged-3a041c70-20e3-4bf5-a771-b64105c39036 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Instance destroyed successfully.
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.objects.instance [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'resources' on Instance uuid ceb5e49c-ad73-48f0-bfe0-b8f18141818d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1733279661',display_name='tempest-AttachVolumeNegativeTest-server-1733279661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1733279661',id=30,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgIDEBTHw8LtzgfJ80dI+yBjTZjttZgNfFbSxYrSj3o+f6O3YJEqtwTnHN+2WXAYjPZZI/nZ1pUTrAl79+0yhQxiztLNsAwzZooGOiMdbvCoGsMzeizs809zf/SryaDkA==',key_name='tempest-keypair-1586161893',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-fklqi0r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=ceb5e49c-ad73-48f0-bfe0-b8f18141818d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "3a041c70-20e3-4bf5-a771-b64105c39036", "address": "fa:16:3e:fa:74:b7", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a041c70-20", "ovs_interfaceid": "3a041c70-20e3-4bf5-a771-b64105c39036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG os_vif [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a041c70-20, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d8a6ff0-1c45-447f-aecd-704e0fc76065) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:24 user nova-compute[86931]: INFO os_vif [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=3a041c70-20e3-4bf5-a771-b64105c39036,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a041c70-20')
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Deleting instance files /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d_del
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Deletion of /opt/stack/data/nova/instances/ceb5e49c-ad73-48f0-bfe0-b8f18141818d_del complete
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.compute.manager [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.compute.manager [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Terminating instance
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-450a37a4-bb89-4632-8c57-3354f2e57455 req-47abc7f4-cf1f-49a8-a540-1575e1969635 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-deleted-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.compute.manager [req-450a37a4-bb89-4632-8c57-3354f2e57455 req-47abc7f4-cf1f-49a8-a540-1575e1969635 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Neutron deleted interface 3a041c70-20e3-4bf5-a771-b64105c39036; detaching it from the instance and deleting it from the info cache
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.network.neutron [req-450a37a4-bb89-4632-8c57-3354f2e57455 req-47abc7f4-cf1f-49a8-a540-1575e1969635 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:24 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Took 0.68 seconds to deallocate network for instance.
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-450a37a4-bb89-4632-8c57-3354f2e57455 req-47abc7f4-cf1f-49a8-a540-1575e1969635 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Detach interface failed, port_id=3a041c70-20e3-4bf5-a771-b64105c39036, reason: Instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:25 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Deleted allocations for instance ceb5e49c-ad73-48f0-bfe0-b8f18141818d
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-30f0830a-0828-44f1-89da-c1fffd5681f0 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.037s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: afe35609-1004-4958-9893-d82894b6f297] Instance destroyed successfully.
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lazy-loading 'resources' on Instance uuid afe35609-1004-4958-9893-d82894b6f297 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1781516197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1781516197',id=4,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:22:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97456514d9f541ec936e509c558e60db',ramdisk_id='',reservation_id='r-k8m1l0pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:23:44Z,user_data=None,user_id='3c8c15e0597f411f81270cd3b181043b',uuid=afe35609-1004-4958-9893-d82894b6f297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converting VIF {"id": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "address": "fa:16:3e:58:04:8c", "network": {"id": "fd8d54d3-6495-43cd-a895-64babdd89969", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-839025394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97456514d9f541ec936e509c558e60db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd18e7a7a-37", "ovs_interfaceid": "d18e7a7a-3764-4020-bf58-2cea6a96a0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG os_vif [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd18e7a7a-37, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6600f5d-284a-4f92-9dad-a6916352814b) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:25 user nova-compute[86931]: INFO os_vif [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:04:8c,bridge_name='br-int',has_traffic_filtering=True,id=d18e7a7a-3764-4020-bf58-2cea6a96a0c2,network=Network(fd8d54d3-6495-43cd-a895-64babdd89969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd18e7a7a-37')
Nov 16 19:41:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Deleting instance files /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297_del
Nov 16 19:41:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Deletion of /opt/stack/data/nova/instances/afe35609-1004-4958-9893-d82894b6f297_del complete
Nov 16 19:41:25 user nova-compute[86931]: INFO nova.compute.manager [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] [instance: afe35609-1004-4958-9893-d82894b6f297] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: afe35609-1004-4958-9893-d82894b6f297] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: afe35609-1004-4958-9893-d82894b6f297] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Acquiring lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "ceb5e49c-ad73-48f0-bfe0-b8f18141818d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] No waiting events found dispatching network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:25 user nova-compute[86931]: WARNING nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: ceb5e49c-ad73-48f0-bfe0-b8f18141818d] Received unexpected event network-vif-plugged-3a041c70-20e3-4bf5-a771-b64105c39036 for instance with vm_state deleted and task_state None.
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-unplugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] No waiting events found dispatching network-vif-unplugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-unplugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Acquiring lock "afe35609-1004-4958-9893-d82894b6f297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] Lock "afe35609-1004-4958-9893-d82894b6f297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:25 user nova-compute[86931]: DEBUG nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] No waiting events found dispatching network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:25 user nova-compute[86931]: WARNING nova.compute.manager [req-feb0bd8e-ae31-42f7-bf5e-af75dbf073b1 req-516bcaae-57f9-407d-9b59-35456e902494 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received unexpected event network-vif-plugged-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 for instance with vm_state active and task_state deleting.
Nov 16 19:41:26 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: afe35609-1004-4958-9893-d82894b6f297] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:26 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: afe35609-1004-4958-9893-d82894b6f297] Took 0.41 seconds to deallocate network for instance.
Nov 16 19:41:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:26 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:41:26 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:41:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:26 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Deleted allocations for instance afe35609-1004-4958-9893-d82894b6f297
Nov 16 19:41:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f3fed1ab-dea0-4707-9401-09a333294544 tempest-ServerBootFromVolumeStableRescueTest-1979208680 tempest-ServerBootFromVolumeStableRescueTest-1979208680-project-member] Lock "afe35609-1004-4958-9893-d82894b6f297" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-1f91a48c-a849-471d-9f02-1439a4dfb8cd req-c88af8b0-d93f-44b0-b5ea-dee4ec5411a7 service nova] [instance: afe35609-1004-4958-9893-d82894b6f297] Received event network-vif-deleted-d18e7a7a-3764-4020-bf58-2cea6a96a0c2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:39 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:41:39 user nova-compute[86931]: INFO nova.compute.claims [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Claim successful on node user
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:41:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.policy [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a00a0387df984129850f1fb1e29a35ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6184534338e74f3d827b9aee3e20c617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:41:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Creating image(s)
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk 1073741824" returned: 0 in 0.058s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Successfully created port: 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Cannot resize image /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Ensure instance console log exists: /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Successfully updated port: 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.compute.manager [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing instance network info cache due to event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:41 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance network_info: |[{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.neutron [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start _get_guest_xml network_info=[{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:41:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:41:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3WQIozmJvqyfadaheJdwm7XTfCi56jtJxG6zTwGrOBTz3btDIifw97R2IPte8aGHlUWNMn9k/l407bJ7SC+AD3laovrRtX5Cf6qVSBb78G3GSYgX73izXV/zuW4nWrFA==',key_name='tempest-keypair-406939974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_devices' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:41:42 user nova-compute[86931]:   <uuid>c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</uuid>
Nov 16 19:41:42 user nova-compute[86931]:   <name>instance-00000025</name>
Nov 16 19:41:42 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:41:42 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:41:42 user nova-compute[86931]:   <metadata>
Nov 16 19:41:42 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:41:42 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-961972779</nova:name>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:41:42</nova:creationTime>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:41:42 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:41:42 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:owner>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:user uuid="a00a0387df984129850f1fb1e29a35ce">tempest-AttachVolumeShelveTestJSON-470403389-project-member</nova:user>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:project uuid="6184534338e74f3d827b9aee3e20c617">tempest-AttachVolumeShelveTestJSON-470403389</nova:project>
Nov 16 19:41:42 user nova-compute[86931]:       </nova:owner>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:41:42 user nova-compute[86931]:       <nova:ports>
Nov 16 19:41:42 user nova-compute[86931]:         <nova:port uuid="37051a47-6c49-45f9-a71d-8dd7d07beeeb">
Nov 16 19:41:42 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:41:42 user nova-compute[86931]:         </nova:port>
Nov 16 19:41:42 user nova-compute[86931]:       </nova:ports>
Nov 16 19:41:42 user nova-compute[86931]:     </nova:instance>
Nov 16 19:41:42 user nova-compute[86931]:   </metadata>
Nov 16 19:41:42 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:41:42 user nova-compute[86931]:     <system>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="serial">c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</entry>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="uuid">c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</entry>
Nov 16 19:41:42 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:41:42 user nova-compute[86931]:     </system>
Nov 16 19:41:42 user nova-compute[86931]:   </sysinfo>
Nov 16 19:41:42 user nova-compute[86931]:   <os>
Nov 16 19:41:42 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:41:42 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:41:42 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:41:42 user nova-compute[86931]:   </os>
Nov 16 19:41:42 user nova-compute[86931]:   <features>
Nov 16 19:41:42 user nova-compute[86931]:     <acpi/>
Nov 16 19:41:42 user nova-compute[86931]:     <apic/>
Nov 16 19:41:42 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:41:42 user nova-compute[86931]:   </features>
Nov 16 19:41:42 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:41:42 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:41:42 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:41:42 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:41:42 user nova-compute[86931]:   </clock>
Nov 16 19:41:42 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:41:42 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:41:42 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:41:42 user nova-compute[86931]:   </cpu>
Nov 16 19:41:42 user nova-compute[86931]:   <devices>
Nov 16 19:41:42 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:41:42 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:41:42 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk"/>
Nov 16 19:41:42 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:41:42 user nova-compute[86931]:     </disk>
Nov 16 19:41:42 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:41:42 user nova-compute[86931]:       <mac address="fa:16:3e:b7:97:8e"/>
Nov 16 19:41:42 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:41:42 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:41:42 user nova-compute[86931]:       <target dev="tap37051a47-6c"/>
Nov 16 19:41:42 user nova-compute[86931]:     </interface>
Nov 16 19:41:42 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:41:42 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/console.log" append="off"/>
Nov 16 19:41:42 user nova-compute[86931]:     </serial>
Nov 16 19:41:42 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:41:42 user nova-compute[86931]:     <video>
Nov 16 19:41:42 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:41:42 user nova-compute[86931]:     </video>
Nov 16 19:41:42 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:41:42 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:41:42 user nova-compute[86931]:     </rng>
Nov 16 19:41:42 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:41:42 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:41:42 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:41:42 user nova-compute[86931]:     </memballoon>
Nov 16 19:41:42 user nova-compute[86931]:   </devices>
Nov 16 19:41:42 user nova-compute[86931]: </domain>
Nov 16 19:41:42 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3WQIozmJvqyfadaheJdwm7XTfCi56jtJxG6zTwGrOBTz3btDIifw97R2IPte8aGHlUWNMn9k/l407bJ7SC+AD3laovrRtX5Cf6qVSBb78G3GSYgX73izXV/zuW4nWrFA==',key_name='tempest-keypair-406939974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG os_vif [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e530e409-6e67-577e-b9b6-fbda5f30b2ad', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37051a47-6c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37051a47-6c, col_values=(('qos', UUID('ac405a68-6a6a-4b91-be3d-948900aa15b3')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37051a47-6c, col_values=(('external_ids', {'iface-id': '37051a47-6c49-45f9-a71d-8dd7d07beeeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:97:8e', 'vm-uuid': 'c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:42 user nova-compute[86931]: INFO os_vif [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c')
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No VIF found with MAC fa:16:3e:b7:97:8e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.neutron [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updated VIF entry in instance network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG nova.network.neutron [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-377f0bfd-1d39-4bbe-9a6d-f19de047cb9f req-f4c1467d-f455-4685-b81e-a2a2604fcd5d service nova] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:43 user nova-compute[86931]: DEBUG nova.compute.manager [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:43 user nova-compute[86931]: WARNING nova.compute.manager [req-86e5f82e-3ac1-4479-a33c-d3d82941bd37 req-9d2ecdec-f50d-4bc7-b663-bf937c90914b service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state building and task_state spawning.
Nov 16 19:41:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:41:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance spawned successfully.
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:41:45 user nova-compute[86931]: INFO nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:45 user nova-compute[86931]: WARNING nova.compute.manager [req-7b274d02-fd6c-4df8-a3f5-40699f246200 req-837dca4c-1eb6-494b-a1e9-c0772d96a313 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state building and task_state spawning.
Nov 16 19:41:45 user nova-compute[86931]: INFO nova.compute.manager [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Took 5.96 seconds to build instance.
Nov 16 19:41:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e4544d4e-8b56-4954-bec4-b5d4f2a0b579 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.076s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:48 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:41:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:41:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:41:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.35428237915039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a29e474f-1d9d-49e8-bccb-b252d7168ab1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:41:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:41:57 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:41:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing instance network info cache due to event network-changed-03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] Acquiring lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] Acquired lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Refreshing network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:59 user nova-compute[86931]: INFO nova.compute.manager [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Terminating instance
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-unplugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] No waiting events found dispatching network-vif-unplugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-6f213a49-231f-4c99-96e7-9539c91d14b1 req-50ab9b69-a29d-42e6-b0b1-4728c84f580b service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-unplugged-03a37e09-338e-4907-9ed4-cf79480f3807 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updated VIF entry in instance network info cache for port 03a37e09-338e-4907-9ed4-cf79480f3807. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating instance_info_cache with network_info: [{"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:41:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-dad4fe7e-148c-40ac-b4de-ee6176433003 req-c8e311ce-54ec-4fe6-ad79-c37346dda33a service nova] Releasing lock "refresh_cache-a29e474f-1d9d-49e8-bccb-b252d7168ab1" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Instance destroyed successfully.
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.objects.instance [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lazy-loading 'resources' on Instance uuid a29e474f-1d9d-49e8-bccb-b252d7168ab1 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-781407118',display_name='tempest-TestVolumeBootPattern-server-781407118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-781407118',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5o3eBcm+vM/bjOFvC990ONXzTodSA0TRXW5YOP0f1OCZf3Zug/s2jbYM3ui4wi5csWzwXnqYQ0Fb+DXsBdceYHUbAI6UOnkaJVs75bodEews3Ulw7y0Ah98+YxUJRmQ==',key_name='tempest-TestVolumeBootPattern-2048262256',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:37:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae1bbd144fb4a83988126b487c7874c',ramdisk_id='',reservation_id='r-5mjt2fly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1009954453',owner_user_name='tempest-TestVolumeBootPattern-1009954453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:37:26Z,user_data=None,user_id='c4267a07b6ed4016a246e2eca5a019f6',uuid=a29e474f-1d9d-49e8-bccb-b252d7168ab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converting VIF {"id": "03a37e09-338e-4907-9ed4-cf79480f3807", "address": "fa:16:3e:29:5c:da", "network": {"id": "f0d80d9f-9e24-4b30-9c7e-c88705419966", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-632013579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae1bbd144fb4a83988126b487c7874c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a37e09-33", "ovs_interfaceid": "03a37e09-338e-4907-9ed4-cf79480f3807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_vif [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a37e09-33, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c648e254-b05d-4ed1-9aba-d3303af1ffdb) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:00 user nova-compute[86931]: INFO os_vif [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=03a37e09-338e-4907-9ed4-cf79480f3807,network=Network(f0d80d9f-9e24-4b30-9c7e-c88705419966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a37e09-33')
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IODwXREl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:42:00 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0805d067-2634-4593-a0fa-583731e2d0ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:42:00 user nova-compute[86931]: No targets found.
Nov 16 19:42:00 user nova-compute[86931]: iSNS:
Nov 16 19:42:00 user nova-compute[86931]: No targets found.
Nov 16 19:42:00 user nova-compute[86931]: STATIC:
Nov 16 19:42:00 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409
Nov 16 19:42:00 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:42:00 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:42:00 user nova-compute[86931]: FIRMWARE:
Nov 16 19:42:00 user nova-compute[86931]: No targets found.
Nov 16 19:42:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:42:00 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:42:00 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4838f6-137b-40d8-84a3-6bb825fd822d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53489be-e838-4fee-98a7-6802ec3151a3]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:42:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 (non-flash)
Nov 16 19:42:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c464e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409'): ({'sde'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Removing single pathed devices sde {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d883dd-ffd6-40db-abea-d69f07c64854]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db43a8a9-3bc5-435c-bcc1-4b07066604df]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Flushing IO for device /dev/sde {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86341232-0d77-48d1-a288-8e27430a93ea]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8a904-ca8a-4333-b8e8-71f993c198a5]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] SCSI volumes sde have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26430383964303866', '/dev/disk/by-id/scsi-1SCST_BIOf5d41e44-d089d08fd4d54327', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f5d41e44') {{(pid=97490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78d93fe-ec91-4ba6-a672-df99304c563b]: (4, None) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb2277-4575-4234-9020-550a22ff2a70]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cba782-d516-4d1b-b393-d75c2384ba4f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260]
Nov 16 19:42:00 user nova-compute[86931]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409, portal: 172.16.0.220,3260] successful.
Nov 16 19:42:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7cb7c5a-08ec-46f1-8e73-ae067625a409 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde2d85-723b-4a03-bf79-5272a9c0e7ac]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] <== disconnect_volume: return (309ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:42:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Deleting instance files /opt/stack/data/nova/instances/a29e474f-1d9d-49e8-bccb-b252d7168ab1_del
Nov 16 19:42:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Deletion of /opt/stack/data/nova/instances/a29e474f-1d9d-49e8-bccb-b252d7168ab1_del complete
Nov 16 19:42:00 user nova-compute[86931]: INFO nova.compute.manager [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 19:42:00 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:42:00 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:01 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Took 0.51 seconds to deallocate network for instance.
Nov 16 19:42:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-a77c2933-8b23-4806-aabf-46649b2b4f73 req-e41e513d-230d-4bed-8bb3-29af6b307180 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-deleted-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] Acquiring lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:01 user nova-compute[86931]: DEBUG nova.compute.manager [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] No waiting events found dispatching network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:01 user nova-compute[86931]: WARNING nova.compute.manager [req-526f268c-2724-49c4-a388-1345ccb72704 req-dfa94154-a2c5-405e-9321-7f2daf8dbcb2 service nova] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Received unexpected event network-vif-plugged-03a37e09-338e-4907-9ed4-cf79480f3807 for instance with vm_state active and task_state deleting.
Nov 16 19:42:02 user nova-compute[86931]: INFO nova.compute.manager [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] [instance: a29e474f-1d9d-49e8-bccb-b252d7168ab1] Took 0.78 seconds to detach 1 volumes for instance.
Nov 16 19:42:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:02 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:42:02 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:42:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:02 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Deleted allocations for instance a29e474f-1d9d-49e8-bccb-b252d7168ab1
Nov 16 19:42:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-f4857efc-ba4b-4247-9aa3-3e7ad8c353d8 tempest-TestVolumeBootPattern-1009954453 tempest-TestVolumeBootPattern-1009954453-project-member] Lock "a29e474f-1d9d-49e8-bccb-b252d7168ab1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:17 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:42:17 user nova-compute[86931]: INFO nova.compute.claims [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Claim successful on node user
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:42:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.policy [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7112607a7774345b8879d0422b8b94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ee3cb7b348423c81c90a733038d9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:42:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Creating image(s)
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "/opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk 1073741824" returned: 0 in 0.058s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Successfully created port: 6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Cannot resize image /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Ensure instance console log exists: /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Successfully updated port: 6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquired lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-changed-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Refreshing instance network info cache due to event network-changed-6f15ffa0-f6a8-4200-b383-c1c65c147619. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] Acquiring lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:42:20 user nova-compute[86931]: INFO nova.compute.claims [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Claim successful on node user
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Updating instance_info_cache with network_info: [{"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Releasing lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Instance network_info: |[{"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] Acquired lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.neutron [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Refreshing network info cache for port 6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Start _get_guest_xml network_info=[{"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:42:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-216839388',display_name='tempest-AttachVolumeNegativeTest-server-216839388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-216839388',id=38,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaS822uHiMtEf6i4KxR5zkyFpLQoyGnWtnBKUp6ZE9mqKzKjVyjxgSwfCWYhCYWXdhzVv0klI7PpKChNUZdhMiZ4mpR9789kzn+gYC+tGHn5bWWik+joLygjROi88h5VQ==',key_name='tempest-keypair-1224297882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-ysaabeuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b529951e-831f-4bbe-8262-98862b956679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.objects.instance [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'pci_devices' on Instance uuid b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:42:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:42:20 user nova-compute[86931]:   <uuid>b529951e-831f-4bbe-8262-98862b956679</uuid>
Nov 16 19:42:20 user nova-compute[86931]:   <name>instance-00000026</name>
Nov 16 19:42:20 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:42:20 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:42:20 user nova-compute[86931]:   <metadata>
Nov 16 19:42:20 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:42:20 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeNegativeTest-server-216839388</nova:name>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:42:20</nova:creationTime>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:42:20 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:42:20 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:owner>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:user uuid="d7112607a7774345b8879d0422b8b94c">tempest-AttachVolumeNegativeTest-57450610-project-member</nova:user>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:project uuid="a3ee3cb7b348423c81c90a733038d9ff">tempest-AttachVolumeNegativeTest-57450610</nova:project>
Nov 16 19:42:20 user nova-compute[86931]:       </nova:owner>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:42:20 user nova-compute[86931]:       <nova:ports>
Nov 16 19:42:20 user nova-compute[86931]:         <nova:port uuid="6f15ffa0-f6a8-4200-b383-c1c65c147619">
Nov 16 19:42:20 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:42:20 user nova-compute[86931]:         </nova:port>
Nov 16 19:42:20 user nova-compute[86931]:       </nova:ports>
Nov 16 19:42:20 user nova-compute[86931]:     </nova:instance>
Nov 16 19:42:20 user nova-compute[86931]:   </metadata>
Nov 16 19:42:20 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:42:20 user nova-compute[86931]:     <system>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="serial">b529951e-831f-4bbe-8262-98862b956679</entry>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="uuid">b529951e-831f-4bbe-8262-98862b956679</entry>
Nov 16 19:42:20 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:42:20 user nova-compute[86931]:     </system>
Nov 16 19:42:20 user nova-compute[86931]:   </sysinfo>
Nov 16 19:42:20 user nova-compute[86931]:   <os>
Nov 16 19:42:20 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:42:20 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:42:20 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:42:20 user nova-compute[86931]:   </os>
Nov 16 19:42:20 user nova-compute[86931]:   <features>
Nov 16 19:42:20 user nova-compute[86931]:     <acpi/>
Nov 16 19:42:20 user nova-compute[86931]:     <apic/>
Nov 16 19:42:20 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:42:20 user nova-compute[86931]:   </features>
Nov 16 19:42:20 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:42:20 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:42:20 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:42:20 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:42:20 user nova-compute[86931]:   </clock>
Nov 16 19:42:20 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:42:20 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:42:20 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:42:20 user nova-compute[86931]:   </cpu>
Nov 16 19:42:20 user nova-compute[86931]:   <devices>
Nov 16 19:42:20 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:42:20 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:42:20 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk"/>
Nov 16 19:42:20 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:42:20 user nova-compute[86931]:     </disk>
Nov 16 19:42:20 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:42:20 user nova-compute[86931]:       <mac address="fa:16:3e:f1:1d:b8"/>
Nov 16 19:42:20 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:20 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:42:20 user nova-compute[86931]:       <target dev="tap6f15ffa0-f6"/>
Nov 16 19:42:20 user nova-compute[86931]:     </interface>
Nov 16 19:42:20 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:42:20 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/console.log" append="off"/>
Nov 16 19:42:20 user nova-compute[86931]:     </serial>
Nov 16 19:42:20 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:42:20 user nova-compute[86931]:     <video>
Nov 16 19:42:20 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:20 user nova-compute[86931]:     </video>
Nov 16 19:42:20 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:42:20 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:42:20 user nova-compute[86931]:     </rng>
Nov 16 19:42:20 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:42:20 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:42:20 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:42:20 user nova-compute[86931]:     </memballoon>
Nov 16 19:42:20 user nova-compute[86931]:   </devices>
Nov 16 19:42:20 user nova-compute[86931]: </domain>
Nov 16 19:42:20 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-216839388',display_name='tempest-AttachVolumeNegativeTest-server-216839388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-216839388',id=38,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaS822uHiMtEf6i4KxR5zkyFpLQoyGnWtnBKUp6ZE9mqKzKjVyjxgSwfCWYhCYWXdhzVv0klI7PpKChNUZdhMiZ4mpR9789kzn+gYC+tGHn5bWWik+joLygjROi88h5VQ==',key_name='tempest-keypair-1224297882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-ysaabeuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b529951e-831f-4bbe-8262-98862b956679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG os_vif [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1fce389-68cb-5213-8676-06cab9c9c91a', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f15ffa0-f6, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f15ffa0-f6, col_values=(('qos', UUID('f8bbac00-3332-42e7-a289-4bbf51bcdf0a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f15ffa0-f6, col_values=(('external_ids', {'iface-id': '6f15ffa0-f6a8-4200-b383-c1c65c147619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:1d:b8', 'vm-uuid': 'b529951e-831f-4bbe-8262-98862b956679'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:20 user nova-compute[86931]: INFO os_vif [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6')
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.policy [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '929b3c5212494c0fa7b3f1abdc6650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8ba4c38fb4c5baac62b4d799134d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:f1:1d:b8, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:42:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Creating image(s)
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.part --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG nova.virt.images [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] 49c32d05-c48f-40bc-8b83-d49811dc92e5 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.part /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Successfully created port: eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Updated VIF entry in instance network info cache for port 6f15ffa0-f6a8-4200-b383-c1c65c147619. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Updating instance_info_cache with network_info: [{"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c20f6deb-1422-44cb-a275-4ba8b02a7c11 req-1d132720-e162-4889-b0f1-c57ba3547679 service nova] Releasing lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.part /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.converted" returned: 0 in 0.731s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] No waiting events found dispatching network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:22 user nova-compute[86931]: WARNING nova.compute.manager [req-60c07e3a-a797-4b93-8079-1c08b2837f7b req-59d4d074-ee5d-426a-bdae-03928f063f3f service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received unexpected event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 for instance with vm_state building and task_state spawning.
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35.converted --force-share --output=json" returned: 0 in 0.227s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.802s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json" returned: 0 in 0.207s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Successfully updated port: eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing instance network info cache due to event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35,backing_fmt=raw /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35,backing_fmt=raw /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk 1073741824" returned: 0 in 0.087s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "2baaeb9a868e589b30e9420b7fff833ba8f27e35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b4c3475-e7ff-45ea-b6c6-67048931e063 req-1f4c57c7-25f4-4b60-92fc-34ba3bd546c3 service nova] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Cannot resize image /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Ensure instance console log exists: /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance network_info: |[{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start _get_guest_xml network_info=[{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:42:17Z,direct_url=<?>,disk_format='qcow2',id=49c32d05-c48f-40bc-8b83-d49811dc92e5,min_disk=0,min_ram=0,name='tempest-scenario-img--1093717538',owner='63c8ba4c38fb4c5baac62b4d799134d8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:42:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '49c32d05-c48f-40bc-8b83-d49811dc92e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:42:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:42:17Z,direct_url=<?>,disk_format='qcow2',id=49c32d05-c48f-40bc-8b83-d49811dc92e5,min_disk=0,min_ram=0,name='tempest-scenario-img--1093717538',owner='63c8ba4c38fb4c5baac62b4d799134d8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:42:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:21Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.objects.instance [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'pci_devices' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:42:23 user nova-compute[86931]:   <uuid>114766b0-9ff3-40f6-bd7d-e6694c8acf4e</uuid>
Nov 16 19:42:23 user nova-compute[86931]:   <name>instance-00000027</name>
Nov 16 19:42:23 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:42:23 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:42:23 user nova-compute[86931]:   <metadata>
Nov 16 19:42:23 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:42:23 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:name>tempest-TestMinimumBasicScenario-server-839705922</nova:name>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:42:23</nova:creationTime>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:42:23 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:42:23 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:owner>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:user uuid="929b3c5212494c0fa7b3f1abdc6650a2">tempest-TestMinimumBasicScenario-708135349-project-member</nova:user>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:project uuid="63c8ba4c38fb4c5baac62b4d799134d8">tempest-TestMinimumBasicScenario-708135349</nova:project>
Nov 16 19:42:23 user nova-compute[86931]:       </nova:owner>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:root type="image" uuid="49c32d05-c48f-40bc-8b83-d49811dc92e5"/>
Nov 16 19:42:23 user nova-compute[86931]:       <nova:ports>
Nov 16 19:42:23 user nova-compute[86931]:         <nova:port uuid="eb225ebc-09ef-4f94-8f7a-19d247eae018">
Nov 16 19:42:23 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:42:23 user nova-compute[86931]:         </nova:port>
Nov 16 19:42:23 user nova-compute[86931]:       </nova:ports>
Nov 16 19:42:23 user nova-compute[86931]:     </nova:instance>
Nov 16 19:42:23 user nova-compute[86931]:   </metadata>
Nov 16 19:42:23 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:42:23 user nova-compute[86931]:     <system>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="serial">114766b0-9ff3-40f6-bd7d-e6694c8acf4e</entry>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="uuid">114766b0-9ff3-40f6-bd7d-e6694c8acf4e</entry>
Nov 16 19:42:23 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:42:23 user nova-compute[86931]:     </system>
Nov 16 19:42:23 user nova-compute[86931]:   </sysinfo>
Nov 16 19:42:23 user nova-compute[86931]:   <os>
Nov 16 19:42:23 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:42:23 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:42:23 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:42:23 user nova-compute[86931]:   </os>
Nov 16 19:42:23 user nova-compute[86931]:   <features>
Nov 16 19:42:23 user nova-compute[86931]:     <acpi/>
Nov 16 19:42:23 user nova-compute[86931]:     <apic/>
Nov 16 19:42:23 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:42:23 user nova-compute[86931]:   </features>
Nov 16 19:42:23 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:42:23 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:42:23 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:42:23 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:42:23 user nova-compute[86931]:   </clock>
Nov 16 19:42:23 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:42:23 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:42:23 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:42:23 user nova-compute[86931]:   </cpu>
Nov 16 19:42:23 user nova-compute[86931]:   <devices>
Nov 16 19:42:23 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:42:23 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:42:23 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk"/>
Nov 16 19:42:23 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:42:23 user nova-compute[86931]:     </disk>
Nov 16 19:42:23 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:42:23 user nova-compute[86931]:       <mac address="fa:16:3e:8e:81:9e"/>
Nov 16 19:42:23 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:23 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:42:23 user nova-compute[86931]:       <target dev="tapeb225ebc-09"/>
Nov 16 19:42:23 user nova-compute[86931]:     </interface>
Nov 16 19:42:23 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:42:23 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/console.log" append="off"/>
Nov 16 19:42:23 user nova-compute[86931]:     </serial>
Nov 16 19:42:23 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:42:23 user nova-compute[86931]:     <video>
Nov 16 19:42:23 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:23 user nova-compute[86931]:     </video>
Nov 16 19:42:23 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:42:23 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:42:23 user nova-compute[86931]:     </rng>
Nov 16 19:42:23 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:42:23 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:42:23 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:42:23 user nova-compute[86931]:     </memballoon>
Nov 16 19:42:23 user nova-compute[86931]:   </devices>
Nov 16 19:42:23 user nova-compute[86931]: </domain>
Nov 16 19:42:23 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:21Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG os_vif [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '533a213b-64e6-5165-8269-83eaa6b7bcea', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb225ebc-09, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb225ebc-09, col_values=(('qos', UUID('e10f1a8c-6ae8-4a9c-b7b5-9f4723e5febb')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb225ebc-09, col_values=(('external_ids', {'iface-id': 'eb225ebc-09ef-4f94-8f7a-19d247eae018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:81:9e', 'vm-uuid': '114766b0-9ff3-40f6-bd7d-e6694c8acf4e'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:23 user nova-compute[86931]: INFO os_vif [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09')
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:42:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No VIF found with MAC fa:16:3e:8e:81:9e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] No waiting events found dispatching network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:24 user nova-compute[86931]: WARNING nova.compute.manager [req-c7b9530b-af66-4e3e-a27a-10b62bc19a38 req-c0ecb079-0fa1-41fd-a16e-56090ac8529d service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received unexpected event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 for instance with vm_state building and task_state spawning.
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:42:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b529951e-831f-4bbe-8262-98862b956679] Instance spawned successfully.
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:24 user nova-compute[86931]: INFO nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 16 19:42:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:42:24 user nova-compute[86931]: INFO nova.compute.manager [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Took 6.74 seconds to build instance.
Nov 16 19:42:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6c9b2f2f-5356-4316-9f75-c8cb9298bedf tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.878s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:26 user nova-compute[86931]: WARNING nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state building and task_state spawning.
Nov 16 19:42:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:26 user nova-compute[86931]: WARNING nova.compute.manager [req-b8630944-4bc1-4ab8-8e77-32adfa872f2b req-61c1699f-0e28-488e-909e-2ca4f3613d71 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state building and task_state spawning.
Nov 16 19:42:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:42:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance spawned successfully.
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:27 user nova-compute[86931]: INFO nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 16 19:42:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:42:27 user nova-compute[86931]: INFO nova.compute.manager [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Took 7.56 seconds to build instance.
Nov 16 19:42:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-95bb5408-b984-4ad8-8a96-baf8d53186ac tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.665s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:29 user nova-compute[86931]: INFO nova.compute.manager [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Unrescuing
Nov 16 19:42:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'flavor' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:30 user nova-compute[86931]: WARNING nova.compute.manager [req-710bf1cc-7984-4e2a-9e1e-7af59e4d0179 req-4e588f9f-ab01-4267-af66-186622fae745 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:42:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance destroyed successfully.
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG nova.compute.manager [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:32 user nova-compute[86931]: DEBUG nova.compute.manager [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:32 user nova-compute[86931]: WARNING nova.compute.manager [req-66786df0-9b30-4097-9eec-ed21fd17c16d req-23afe133-35fc-42bb-8d54-0ab4ce891949 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:42:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:34 user nova-compute[86931]: WARNING nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:42:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:34 user nova-compute[86931]: DEBUG nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:34 user nova-compute[86931]: WARNING nova.compute.manager [req-a3533dc6-09d5-4d5b-acbe-6ac61ab7f76f req-55ac2193-111e-4c99-b2b0-14ae6677e131 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:42:34 user nova-compute[86931]: DEBUG nova.compute.manager [None req-364ba9c6-1f6d-4bf0-a6f0-54284eba1bb4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:42:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:48 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:42:49 user nova-compute[86931]: INFO nova.compute.claims [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Claim successful on node user
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:42:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.policy [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7102aa365a7d4bfd96e0bc0a15047405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aef3ed7bde1486196bbdd36846f268b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:42:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Creating image(s)
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "/opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "/opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "/opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.241s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk 1073741824" returned: 0 in 0.060s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Successfully created port: a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Cannot resize image /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Ensure instance console log exists: /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Successfully updated port: a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquired lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-changed-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Refreshing instance network info cache due to event network-changed-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] Acquiring lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updating instance_info_cache with network_info: [{"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Releasing lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Instance network_info: |[{"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] Acquired lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Refreshing network info cache for port a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Start _get_guest_xml network_info=[{"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:42:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2906268',id=40,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUQ8QGZ290TMCoPpNhqODgjOqS3DXKm2gHmKnt3omLhKpRXyOs+viWXe1MlrXfzdtylmOnUP4QyQb7JLc+MGooVKbXobxghInliHx5MSGEtEtphyWRAKWlB3H1rwV/MKg==',key_name='tempest-keypair-1081784419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aef3ed7bde1486196bbdd36846f268b',ramdisk_id='',reservation_id='r-izwl2nsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7102aa365a7d4bfd96e0bc0a15047405',uuid=f413e802-5663-4105-a13f-8f83cdb2db53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converting VIF {"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lazy-loading 'pci_devices' on Instance uuid f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:42:51 user nova-compute[86931]:   <uuid>f413e802-5663-4105-a13f-8f83cdb2db53</uuid>
Nov 16 19:42:51 user nova-compute[86931]:   <name>instance-00000028</name>
Nov 16 19:42:51 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:42:51 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:42:51 user nova-compute[86931]:   <metadata>
Nov 16 19:42:51 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:42:51 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847</nova:name>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:42:51</nova:creationTime>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:42:51 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:42:51 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:owner>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:user uuid="7102aa365a7d4bfd96e0bc0a15047405">tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member</nova:user>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:project uuid="9aef3ed7bde1486196bbdd36846f268b">tempest-TestServerVolumeAttachScenarioOldVersion-327141478</nova:project>
Nov 16 19:42:51 user nova-compute[86931]:       </nova:owner>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:42:51 user nova-compute[86931]:       <nova:ports>
Nov 16 19:42:51 user nova-compute[86931]:         <nova:port uuid="a1d29bc9-d2c9-41d2-b640-e24981c4ae2a">
Nov 16 19:42:51 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 19:42:51 user nova-compute[86931]:         </nova:port>
Nov 16 19:42:51 user nova-compute[86931]:       </nova:ports>
Nov 16 19:42:51 user nova-compute[86931]:     </nova:instance>
Nov 16 19:42:51 user nova-compute[86931]:   </metadata>
Nov 16 19:42:51 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:42:51 user nova-compute[86931]:     <system>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="serial">f413e802-5663-4105-a13f-8f83cdb2db53</entry>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="uuid">f413e802-5663-4105-a13f-8f83cdb2db53</entry>
Nov 16 19:42:51 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:42:51 user nova-compute[86931]:     </system>
Nov 16 19:42:51 user nova-compute[86931]:   </sysinfo>
Nov 16 19:42:51 user nova-compute[86931]:   <os>
Nov 16 19:42:51 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:42:51 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:42:51 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:42:51 user nova-compute[86931]:   </os>
Nov 16 19:42:51 user nova-compute[86931]:   <features>
Nov 16 19:42:51 user nova-compute[86931]:     <acpi/>
Nov 16 19:42:51 user nova-compute[86931]:     <apic/>
Nov 16 19:42:51 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:42:51 user nova-compute[86931]:   </features>
Nov 16 19:42:51 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:42:51 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:42:51 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:42:51 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:42:51 user nova-compute[86931]:   </clock>
Nov 16 19:42:51 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:42:51 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:42:51 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:42:51 user nova-compute[86931]:   </cpu>
Nov 16 19:42:51 user nova-compute[86931]:   <devices>
Nov 16 19:42:51 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:42:51 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:42:51 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk"/>
Nov 16 19:42:51 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:42:51 user nova-compute[86931]:     </disk>
Nov 16 19:42:51 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:42:51 user nova-compute[86931]:       <mac address="fa:16:3e:9c:35:b1"/>
Nov 16 19:42:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:51 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:42:51 user nova-compute[86931]:       <target dev="tapa1d29bc9-d2"/>
Nov 16 19:42:51 user nova-compute[86931]:     </interface>
Nov 16 19:42:51 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:42:51 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/console.log" append="off"/>
Nov 16 19:42:51 user nova-compute[86931]:     </serial>
Nov 16 19:42:51 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:42:51 user nova-compute[86931]:     <video>
Nov 16 19:42:51 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:42:51 user nova-compute[86931]:     </video>
Nov 16 19:42:51 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:42:51 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:42:51 user nova-compute[86931]:     </rng>
Nov 16 19:42:51 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:42:51 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:42:51 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:42:51 user nova-compute[86931]:     </memballoon>
Nov 16 19:42:51 user nova-compute[86931]:   </devices>
Nov 16 19:42:51 user nova-compute[86931]: </domain>
Nov 16 19:42:51 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2906268',id=40,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUQ8QGZ290TMCoPpNhqODgjOqS3DXKm2gHmKnt3omLhKpRXyOs+viWXe1MlrXfzdtylmOnUP4QyQb7JLc+MGooVKbXobxghInliHx5MSGEtEtphyWRAKWlB3H1rwV/MKg==',key_name='tempest-keypair-1081784419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aef3ed7bde1486196bbdd36846f268b',ramdisk_id='',reservation_id='r-izwl2nsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7102aa365a7d4bfd96e0bc0a15047405',uuid=f413e802-5663-4105-a13f-8f83cdb2db53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converting VIF {"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG os_vif [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2267537a-8468-55ac-b542-e94d3a73a704', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1d29bc9-d2, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1d29bc9-d2, col_values=(('qos', UUID('d2546269-6806-49f7-a029-702ef62828c1')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1d29bc9-d2, col_values=(('external_ids', {'iface-id': 'a1d29bc9-d2c9-41d2-b640-e24981c4ae2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:35:b1', 'vm-uuid': 'f413e802-5663-4105-a13f-8f83cdb2db53'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:51 user nova-compute[86931]: INFO os_vif [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2')
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] No VIF found with MAC fa:16:3e:9c:35:b1, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updated VIF entry in instance network info cache for port a1d29bc9-d2c9-41d2-b640-e24981c4ae2a. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updating instance_info_cache with network_info: [{"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-779f1faa-7298-4c55-bf10-1c73e37c5d2b req-04bb2d44-1be9-4660-8dca-cecf9499cd31 service nova] Releasing lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] No waiting events found dispatching network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:53 user nova-compute[86931]: WARNING nova.compute.manager [req-39c8eea9-ecd5-4ae0-8aad-f1bf7cf7fca9 req-369951f0-a748-4a52-8dda-3d3abf49bfab service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received unexpected event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a for instance with vm_state building and task_state spawning.
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:42:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Instance spawned successfully.
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] No waiting events found dispatching network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:42:55 user nova-compute[86931]: WARNING nova.compute.manager [req-825c70c4-3cdc-4ce8-9cdb-687b74ae6c31 req-508e935d-79a8-4079-b363-263b2f958dd5 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received unexpected event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a for instance with vm_state building and task_state spawning.
Nov 16 19:42:55 user nova-compute[86931]: INFO nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 16 19:42:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:55 user nova-compute[86931]: INFO nova.compute.manager [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Took 6.44 seconds to build instance.
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e3095e16-9087-4bcb-959d-2a1726b60260 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:56 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=25.169769287109375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b529951e-831f-4bbe-8262-98862b956679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f413e802-5663-4105-a13f-8f83cdb2db53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:42:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:42:57 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:42:57 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:42:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:42:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:42:58 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:42:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:43:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:43:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:43:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing instance network info cache due to event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updated VIF entry in instance network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG nova.network.neutron [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02c309ea-dddf-4994-bd82-28a19c8128d1 req-05f6bc12-5edc-42c0-bdc1-a5a9e8529048 service nova] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:43:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:35 user nova-compute[86931]: INFO nova.compute.manager [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Shelving
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:43:35 user nova-compute[86931]: WARNING nova.compute.manager [req-0e8dec99-1e58-4921-8ce6-5614b0d0b2c1 req-e098f6c3-7cff-4626-bd23-75feaabc07cd service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state active and task_state shelving.
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance destroyed successfully.
Nov 16 19:43:35 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Beginning cold snapshot process
Nov 16 19:43:36 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:43:36 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk /opt/stack/data/nova/instances/snapshots/tmpaep7rpi7/c0f54ad7ed5f4db0a6739992e724f67c {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk /opt/stack/data/nova/instances/snapshots/tmpaep7rpi7/c0f54ad7ed5f4db0a6739992e724f67c" returned: 0 in 1.163s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Snapshot extracted, beginning image upload
Nov 16 19:43:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:43:37 user nova-compute[86931]: WARNING nova.compute.manager [req-fbc4751a-68f2-41aa-80e8-8be1cc4e89c9 req-7874ad7f-dc34-4049-abe0-cee673f8d373 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 19:43:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Snapshot image upload complete
Nov 16 19:43:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:43:39 user nova-compute[86931]: INFO nova.compute.manager [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Shelve offloading
Nov 16 19:43:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance destroyed successfully.
Nov 16 19:43:39 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:43:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:43:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:43:39 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance destroyed successfully.
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'resources' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3WQIozmJvqyfadaheJdwm7XTfCi56jtJxG6zTwGrOBTz3btDIifw97R2IPte8aGHlUWNMn9k/l407bJ7SC+AD3laovrRtX5Cf6qVSBb78G3GSYgX73izXV/zuW4nWrFA==',key_name='tempest-keypair-406939974',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:43:39.754037',shelved_host='user',shelved_image_id='79aee1a2-7c33-4127-9cbd-206888d007e9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG os_vif [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37051a47-6c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing instance network info cache due to event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG nova.network.neutron [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac405a68-6a6a-4b91-be3d-948900aa15b3) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:43:40 user nova-compute[86931]: INFO os_vif [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c')
Nov 16 19:43:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Deleting instance files /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff_del
Nov 16 19:43:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Deletion of /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff_del complete
Nov 16 19:43:41 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Deleted allocations for instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff
Nov 16 19:43:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'numa_topology' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.objects.base [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff> lazy-loaded attributes: resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a2dce3ec-b177-4f95-865e-6b08f9cd2aa1 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.347s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updated VIF entry in instance network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap37051a47-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:43:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e6b7c588-8a8c-48cb-9459-d205b65f73e1 req-437158fc-cd47-415f-ac2b-5050d0d3eced service nova] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:43:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:43:51 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:43:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:43:55 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:43:55 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=25.11579132080078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b529951e-831f-4bbe-8262-98862b956679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f413e802-5663-4105-a13f-8f83cdb2db53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:43:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Skipping network cache update for instance because it has been migrated to another host. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:43:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:44:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:44:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-changed-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Refreshing instance network info cache due to event network-changed-6f15ffa0-f6a8-4200-b383-c1c65c147619. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:44:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] Acquiring lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] Acquired lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Refreshing network info cache for port 6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:44:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Updated VIF entry in instance network info cache for port 6f15ffa0-f6a8-4200-b383-c1c65c147619. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:44:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Updating instance_info_cache with network_info: [{"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-02d24fda-dcc7-4b36-a53a-780adb3a04f9 req-2c0e886b-e68e-4a7c-af73-25c7d2e155fa service nova] Releasing lock "refresh_cache-b529951e-831f-4bbe-8262-98862b956679" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:10 user nova-compute[86931]: INFO nova.compute.manager [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Attaching volume b63c8c0e-ca4c-4663-843e-6a91b75de8db to /dev/vdb
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.utils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6afa8-5479-45c4-b95d-eb8597b8574a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[59397b8c-0cae-445d-ba30-d2d787244027]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0721b1d-12f0-4070-a074-6d46455c2cdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfe6431-95ca-49b6-80ff-869fb0a6dbba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:10 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:44:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d33af84-ee10-497c-857e-66abca4ca071]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG os_brick.utils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Updating existing volume attachment record: 0ac4be3c-8967-4929-8042-03600beebbeb {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:44:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG nova.objects.instance [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:12 user nova-compute[86931]: INFO nova.compute.manager [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Attaching volume d10540c1-c577-416b-b316-954e8e9fcce9 to /dev/vdb
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.utils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba21c3dc-f9bd-47a7-888e-444cc1bc8a98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb65a33-ff95-4464-a401-8fcd54a72a2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5551fce0-e993-4b1d-9304-4c66130de852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdad1612-f5cb-44c7-8e32-38075e5b31fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:12 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:44:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a473a3-abdc-4b0e-ad24-02306adb9ff4]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG os_brick.utils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:12 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating existing volume attachment record: be9e32c6-deb2-4b35-ae3c-1c339b595ab4 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtvhuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:15 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:15 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:15 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4f76f-14fa-44c6-963f-3b0f4a2f311f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:44:15 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e694e31-2f47-4fc7-acb4-5bc2d387cf31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db] added
Nov 16 19:44:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1e9d3-30ee-4759-92e3-136e715d6f05]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4424447-7f8e-4cec-a61d-c7a5f085ccdc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHtvhuyD {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHtvhuyD" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84f3a0a-1c11-477e-879e-f7e553982cfd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FHtvhuyD'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4070a1d-bfb2-46d9-b497-037efede3474]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6908518a-721a-415d-87a2-29232c2ff02f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:44:15 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:44:15 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:15 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 19:44:15 user nova-compute[86931]: 
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[547bb534-daff-4c2e-a45d-a20960c89aa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260]
Nov 16 19:44:15 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4bdbec-6887-4370-8e44-c8c23f2513e4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff1c650-320a-4d10-92f7-4527d84fe36f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80716b5-13b1-43d3-bb13-6a793a400b2b]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtvhuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23661636562316632', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661636562316632', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:44:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:44:17 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:17 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:17 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:17 user nova-compute[86931]:   <serial>b63c8c0e-ca4c-4663-843e-6a91b75de8db</serial>
Nov 16 19:44:17 user nova-compute[86931]: </disk>
Nov 16 19:44:17 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:17 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:17 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad398b-33ab-41c9-a13a-dd0c407c7fa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:44:17 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c309d6-10ce-4858-bd28-3d52ec2e7156]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9] added
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f53b481-60a1-4190-be1d-22a3ff8aa47d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdf0aa6-5942-4988-a3b9-72e0cf944c6d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKoMsZxF {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKoMsZxF" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f139bc9-9aff-4ba4-8c9f-06556a5a6122]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKoMsZxF'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94c0e3b-af95-4423-ab52-597c05bab054]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e2493-74dd-4254-9e26-5d5148eac0c4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc910458-5a1c-489f-bd15-0c239f50b451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]
Nov 16 19:44:17 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de1d68-6c25-48ea-afe0-8b0350f2d3da]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:f1:1d:b8, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3290521-5415-49a3-b44b-a68a967a701d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:17 user nova-compute[86931]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:17 user nova-compute[86931]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:17 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb1e63b-b446-4190-a078-71e168239162]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d1cfe373-d9cc-4f84-8b43-c2b1e52f6fd7 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.925s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23636336361353830', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636336361353830', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:44:18 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:18 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:44:18 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:18 user nova-compute[86931]:   <serial>d10540c1-c577-416b-b316-954e8e9fcce9</serial>
Nov 16 19:44:18 user nova-compute[86931]: </disk>
Nov 16 19:44:18 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:18 user nova-compute[86931]: INFO nova.compute.manager [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Detaching volume b63c8c0e-ca4c-4663-843e-6a91b75de8db
Nov 16 19:44:18 user nova-compute[86931]: INFO nova.virt.block_device [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Attempting to driver detach volume b63c8c0e-ca4c-4663-843e-6a91b75de8db from mountpoint /dev/vdb
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Attempting to detach device vdb from instance b529951e-831f-4bbe-8262-98862b956679 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:44:18 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:18 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:18 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:18 user nova-compute[86931]:   <serial>b63c8c0e-ca4c-4663-843e-6a91b75de8db</serial>
Nov 16 19:44:18 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:44:18 user nova-compute[86931]: </disk>
Nov 16 19:44:18 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:44:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance b529951e-831f-4bbe-8262-98862b956679 from the persistent domain config.
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b529951e-831f-4bbe-8262-98862b956679 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:44:18 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:18 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:18 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:18 user nova-compute[86931]:   <serial>b63c8c0e-ca4c-4663-843e-6a91b75de8db</serial>
Nov 16 19:44:18 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:44:18 user nova-compute[86931]: </disk>
Nov 16 19:44:18 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No VIF found with MAC fa:16:3e:8e:81:9e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:44:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-26aab1a4-70e7-4e6b-bda6-cf64d9ecca12 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.697s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:44:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing instance network info cache due to event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.network.neutron [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.network.neutron [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updated VIF entry in instance network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.network.neutron [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-926a1783-548a-4763-918e-5d25a9d713b8 req-811eb3aa-1e13-4468-8950-4a481b4b88e0 service nova] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:24 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:44:24 user nova-compute[86931]: INFO nova.compute.claims [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Claim successful on node user
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:44:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.policy [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51a6c7bcc5a54d819a6cfa7187229c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c44cf782aee484eb908f5e0d1a348f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:44:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Creating image(s)
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk 1073741824" returned: 0 in 0.062s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Successfully created port: a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Cannot resize image /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Ensure instance console log exists: /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing instance network info cache due to event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.network.neutron [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Successfully updated port: a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing instance network info cache due to event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updated VIF entry in instance network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-12fda088-f7f0-4e03-8075-28f90b997abb req-987e240b-c389-4537-9b2e-1af3d122e436 service nova] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance network_info: |[{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start _get_guest_xml network_info=[{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:44:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377330977',display_name='tempest-ServerRescueNegativeTestJSON-server-377330977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377330977',id=41,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NN1l2qf2xJjcg1t0BcGxbpaM8vD8QOkYUurVG3LnhyEyzz/V0KnWj/SkfCqnPCaZOw9thL8mPJEhxJX7eohj4snwi8wMsTlbFlS1bVRp+FSodAPNx2qPpScQvT6rMag==',key_name='tempest-keypair-767497068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-tqzj16uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=d583241c-7b40-4992-9e0a-c4c190bace16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:44:27 user nova-compute[86931]:   <uuid>d583241c-7b40-4992-9e0a-c4c190bace16</uuid>
Nov 16 19:44:27 user nova-compute[86931]:   <name>instance-00000029</name>
Nov 16 19:44:27 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:44:27 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:44:27 user nova-compute[86931]:   <metadata>
Nov 16 19:44:27 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:44:27 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377330977</nova:name>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:44:27</nova:creationTime>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:44:27 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:44:27 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:owner>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:44:27 user nova-compute[86931]:       </nova:owner>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:44:27 user nova-compute[86931]:       <nova:ports>
Nov 16 19:44:27 user nova-compute[86931]:         <nova:port uuid="a0d90ba0-4f69-49ee-88bf-3833b772bd0e">
Nov 16 19:44:27 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:44:27 user nova-compute[86931]:         </nova:port>
Nov 16 19:44:27 user nova-compute[86931]:       </nova:ports>
Nov 16 19:44:27 user nova-compute[86931]:     </nova:instance>
Nov 16 19:44:27 user nova-compute[86931]:   </metadata>
Nov 16 19:44:27 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:44:27 user nova-compute[86931]:     <system>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="serial">d583241c-7b40-4992-9e0a-c4c190bace16</entry>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="uuid">d583241c-7b40-4992-9e0a-c4c190bace16</entry>
Nov 16 19:44:27 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:44:27 user nova-compute[86931]:     </system>
Nov 16 19:44:27 user nova-compute[86931]:   </sysinfo>
Nov 16 19:44:27 user nova-compute[86931]:   <os>
Nov 16 19:44:27 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:44:27 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:44:27 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:44:27 user nova-compute[86931]:   </os>
Nov 16 19:44:27 user nova-compute[86931]:   <features>
Nov 16 19:44:27 user nova-compute[86931]:     <acpi/>
Nov 16 19:44:27 user nova-compute[86931]:     <apic/>
Nov 16 19:44:27 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:44:27 user nova-compute[86931]:   </features>
Nov 16 19:44:27 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:44:27 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:44:27 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:44:27 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:44:27 user nova-compute[86931]:   </clock>
Nov 16 19:44:27 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:44:27 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:44:27 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:44:27 user nova-compute[86931]:   </cpu>
Nov 16 19:44:27 user nova-compute[86931]:   <devices>
Nov 16 19:44:27 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:44:27 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:44:27 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk"/>
Nov 16 19:44:27 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:44:27 user nova-compute[86931]:     </disk>
Nov 16 19:44:27 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:44:27 user nova-compute[86931]:       <mac address="fa:16:3e:fe:9d:3d"/>
Nov 16 19:44:27 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:44:27 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:44:27 user nova-compute[86931]:       <target dev="tapa0d90ba0-4f"/>
Nov 16 19:44:27 user nova-compute[86931]:     </interface>
Nov 16 19:44:27 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:44:27 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/console.log" append="off"/>
Nov 16 19:44:27 user nova-compute[86931]:     </serial>
Nov 16 19:44:27 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:44:27 user nova-compute[86931]:     <video>
Nov 16 19:44:27 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:44:27 user nova-compute[86931]:     </video>
Nov 16 19:44:27 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:44:27 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:44:27 user nova-compute[86931]:     </rng>
Nov 16 19:44:27 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:44:27 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:44:27 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:44:27 user nova-compute[86931]:     </memballoon>
Nov 16 19:44:27 user nova-compute[86931]:   </devices>
Nov 16 19:44:27 user nova-compute[86931]: </domain>
Nov 16 19:44:27 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377330977',display_name='tempest-ServerRescueNegativeTestJSON-server-377330977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377330977',id=41,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NN1l2qf2xJjcg1t0BcGxbpaM8vD8QOkYUurVG3LnhyEyzz/V0KnWj/SkfCqnPCaZOw9thL8mPJEhxJX7eohj4snwi8wMsTlbFlS1bVRp+FSodAPNx2qPpScQvT6rMag==',key_name='tempest-keypair-767497068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-tqzj16uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=d583241c-7b40-4992-9e0a-c4c190bace16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG os_vif [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e9b06a2-96b9-51f5-9a48-8cf07d91cee3', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0d90ba0-4f, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0d90ba0-4f, col_values=(('qos', UUID('bbc70558-3914-49e4-bc52-d299d5299779')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0d90ba0-4f, col_values=(('external_ids', {'iface-id': 'a0d90ba0-4f69-49ee-88bf-3833b772bd0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:9d:3d', 'vm-uuid': 'd583241c-7b40-4992-9e0a-c4c190bace16'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:27 user nova-compute[86931]: INFO os_vif [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f')
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:fe:9d:3d, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updated VIF entry in instance network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG nova.network.neutron [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2bc2f802-1502-4211-8cb9-4bfca51ae235 req-24de9c50-f9f3-44c1-a5f4-22b0952febef service nova] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:28 user nova-compute[86931]: WARNING nova.compute.manager [req-952aee10-0053-4968-b5ac-8d9f83f033ab req-a89d7cae-f29a-4499-8e19-1d2974963d7d service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state building and task_state spawning.
Nov 16 19:44:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:29 user nova-compute[86931]: INFO nova.compute.manager [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Rebooting instance
Nov 16 19:44:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance spawned successfully.
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:30 user nova-compute[86931]: WARNING nova.compute.manager [req-40d56e94-791d-455c-9802-f124e8df04c1 req-3f578080-f193-48ab-a3a8-d22a6c39ac82 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 19:44:31 user nova-compute[86931]: INFO nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:31 user nova-compute[86931]: WARNING nova.compute.manager [req-0f3be07f-9cd0-446a-b1d3-bfcecdb14479 req-e675e065-1d57-4aae-915a-429b71ed44e7 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state building and task_state spawning.
Nov 16 19:44:31 user nova-compute[86931]: INFO nova.compute.manager [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Took 6.13 seconds to build instance.
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a6a7ac61-cf94-4080-acf5-fc16efaa388e tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.218s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance destroyed successfully.
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'resources' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:44:31Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb225ebc-09, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e10f1a8c-6ae8-4a9c-b7b5-9f4723e5febb) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:31 user nova-compute[86931]: INFO os_vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09')
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:31 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa42cbc-d7d6-4441-9d31-95c43b9343b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:44:31 user nova-compute[86931]: No targets found.
Nov 16 19:44:31 user nova-compute[86931]: iSNS:
Nov 16 19:44:31 user nova-compute[86931]: No targets found.
Nov 16 19:44:31 user nova-compute[86931]: STATIC:
Nov 16 19:44:31 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db
Nov 16 19:44:31 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:44:31 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:44:31 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9
Nov 16 19:44:31 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:44:31 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:44:31 user nova-compute[86931]: FIRMWARE:
Nov 16 19:44:31 user nova-compute[86931]: No targets found.
Nov 16 19:44:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:44:31 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:44:31 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2985f03-8eb9-462c-8490-3963005b4b41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a16011-5793-43ef-bc0b-b4d958602637]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:31 user nova-compute[86931]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:31 user nova-compute[86931]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c676a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b5167-9c2f-482b-b085-cf50c7ff2096]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7cf31-61a1-446c-bba7-240dd59f4be0]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c8c891-9289-428b-9675-af66a1f442ee]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40026bc-667f-4145-af28-4f46730e0e25]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4498d563-ac9e-46e6-aa96-9f78aad90d0b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad5affd-14aa-4c9f-b17f-b3848ec547cd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]
Nov 16 19:44:31 user nova-compute[86931]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:31 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45ff5d-1f73-40f9-aa5f-9dc2509185d4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== disconnect_volume: return (287ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start _get_guest_xml network_info=[{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=49c32d05-c48f-40bc-8b83-d49811dc92e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '49c32d05-c48f-40bc-8b83-d49811dc92e5'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'be9e32c6-deb2-4b35-ae3c-1c339b595ab4', 'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '114766b0-9ff3-40f6-bd7d-e6694c8acf4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd10540c1-c577-416b-b316-954e8e9fcce9', 'serial': 'd10540c1-c577-416b-b316-954e8e9fcce9'}, 'boot_index': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:44:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:31 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=49c32d05-c48f-40bc-8b83-d49811dc92e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'vcpu_model' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:31 user nova-compute[86931]: DEBUG nova.objects.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Object Instance<114766b0-9ff3-40f6-bd7d-e6694c8acf4e> lazy-loaded attributes: resources,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:32 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:32 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:32 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dff07d-e56e-4db8-8698-0d4245b00b9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:44:32 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8e17d-42ab-4361-82f6-87135e16953f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9] added
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee4476-7c87-4f0f-b34c-dafaed92e5bb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c434f5-8861-445e-ac33-27ce4713e5b9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKoMsZxF {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKoMsZxF" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[07306196-1f04-4b27-8b56-f5816a43eebf]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKoMsZxF'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5982e3d-55ca-4e96-990c-ac85140bc2cc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfec6e9-079c-40c2-abdb-779f093bd6a3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ee62f-0073-4f65-a7c5-6fa0344693c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]
Nov 16 19:44:32 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8295c58d-f3ba-4d58-8639-c649b46ca57a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed3534-dc92-4a4e-89a0-ed095d9d1595]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:32 user nova-compute[86931]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:32 user nova-compute[86931]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:32 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a98d5f-0563-442b-8d4a-f8ba2bc2f17a]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:33 user nova-compute[86931]: WARNING nova.compute.manager [req-c9b3113e-d75d-49fd-8910-1fbb0ab2c363 req-7e11f581-0d0d-4c74-b6ff-9736d08c33d7 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 19:44:33 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23636336361353830', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636336361353830', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:44:31Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.objects.instance [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'pci_devices' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.objects.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Object Instance<114766b0-9ff3-40f6-bd7d-e6694c8acf4e> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:44:33 user nova-compute[86931]:   <uuid>114766b0-9ff3-40f6-bd7d-e6694c8acf4e</uuid>
Nov 16 19:44:33 user nova-compute[86931]:   <name>instance-00000027</name>
Nov 16 19:44:33 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:44:33 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:44:33 user nova-compute[86931]:   <metadata>
Nov 16 19:44:33 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:44:33 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:name>tempest-TestMinimumBasicScenario-server-839705922</nova:name>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:44:31</nova:creationTime>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:44:33 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:44:33 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:owner>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:user uuid="929b3c5212494c0fa7b3f1abdc6650a2">tempest-TestMinimumBasicScenario-708135349-project-member</nova:user>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:project uuid="63c8ba4c38fb4c5baac62b4d799134d8">tempest-TestMinimumBasicScenario-708135349</nova:project>
Nov 16 19:44:33 user nova-compute[86931]:       </nova:owner>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:root type="image" uuid="49c32d05-c48f-40bc-8b83-d49811dc92e5"/>
Nov 16 19:44:33 user nova-compute[86931]:       <nova:ports>
Nov 16 19:44:33 user nova-compute[86931]:         <nova:port uuid="eb225ebc-09ef-4f94-8f7a-19d247eae018">
Nov 16 19:44:33 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 19:44:33 user nova-compute[86931]:         </nova:port>
Nov 16 19:44:33 user nova-compute[86931]:       </nova:ports>
Nov 16 19:44:33 user nova-compute[86931]:     </nova:instance>
Nov 16 19:44:33 user nova-compute[86931]:   </metadata>
Nov 16 19:44:33 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:44:33 user nova-compute[86931]:     <system>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="serial">114766b0-9ff3-40f6-bd7d-e6694c8acf4e</entry>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="uuid">114766b0-9ff3-40f6-bd7d-e6694c8acf4e</entry>
Nov 16 19:44:33 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:44:33 user nova-compute[86931]:     </system>
Nov 16 19:44:33 user nova-compute[86931]:   </sysinfo>
Nov 16 19:44:33 user nova-compute[86931]:   <os>
Nov 16 19:44:33 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:44:33 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:44:33 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:44:33 user nova-compute[86931]:   </os>
Nov 16 19:44:33 user nova-compute[86931]:   <features>
Nov 16 19:44:33 user nova-compute[86931]:     <acpi/>
Nov 16 19:44:33 user nova-compute[86931]:     <apic/>
Nov 16 19:44:33 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:44:33 user nova-compute[86931]:   </features>
Nov 16 19:44:33 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:44:33 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:44:33 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:44:33 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:44:33 user nova-compute[86931]:   </clock>
Nov 16 19:44:33 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:44:33 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:44:33 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:44:33 user nova-compute[86931]:   </cpu>
Nov 16 19:44:33 user nova-compute[86931]:   <devices>
Nov 16 19:44:33 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:44:33 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:44:33 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk"/>
Nov 16 19:44:33 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:44:33 user nova-compute[86931]:     </disk>
Nov 16 19:44:33 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 19:44:33 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:33 user nova-compute[86931]:       <source dev="/dev/sdc"/>
Nov 16 19:44:33 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:44:33 user nova-compute[86931]:       <serial>d10540c1-c577-416b-b316-954e8e9fcce9</serial>
Nov 16 19:44:33 user nova-compute[86931]:     </disk>
Nov 16 19:44:33 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:44:33 user nova-compute[86931]:       <mac address="fa:16:3e:8e:81:9e"/>
Nov 16 19:44:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:44:33 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:44:33 user nova-compute[86931]:       <target dev="tapeb225ebc-09"/>
Nov 16 19:44:33 user nova-compute[86931]:     </interface>
Nov 16 19:44:33 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:44:33 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/console.log" append="off"/>
Nov 16 19:44:33 user nova-compute[86931]:     </serial>
Nov 16 19:44:33 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:44:33 user nova-compute[86931]:     <video>
Nov 16 19:44:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:44:33 user nova-compute[86931]:     </video>
Nov 16 19:44:33 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:44:33 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:44:33 user nova-compute[86931]:     </rng>
Nov 16 19:44:33 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:44:33 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:44:33 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:44:33 user nova-compute[86931]:     </memballoon>
Nov 16 19:44:33 user nova-compute[86931]:   </devices>
Nov 16 19:44:33 user nova-compute[86931]: </domain>
Nov 16 19:44:33 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.objects.instance [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'trusted_certs' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.objects.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Object Instance<114766b0-9ff3-40f6-bd7d-e6694c8acf4e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:44:33 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Cannot resize image /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'migration_context' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.objects.base [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Object Instance<114766b0-9ff3-40f6-bd7d-e6694c8acf4e> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:44:31Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG os_vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '533a213b-64e6-5165-8269-83eaa6b7bcea', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb225ebc-09, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb225ebc-09, col_values=(('qos', UUID('bbd7d01a-0138-4f2c-a093-9ee3e969d5af')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb225ebc-09, col_values=(('external_ids', {'iface-id': 'eb225ebc-09ef-4f94-8f7a-19d247eae018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:81:9e', 'vm-uuid': '114766b0-9ff3-40f6-bd7d-e6694c8acf4e'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:44:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:34 user nova-compute[86931]: INFO os_vif [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09')
Nov 16 19:44:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:36 user nova-compute[86931]: WARNING nova.compute.manager [req-1992e874-de97-4337-8819-d431f0bb83e2 req-1dd8c96e-ce04-46ed-aff0-a8f2d07f53b9 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 19:44:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:44:38 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance rebooted successfully.
Nov 16 19:44:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-75a1b351-7709-496c-840e-1ad055a6dfe5 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.281s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:44:38 user nova-compute[86931]: WARNING nova.compute.manager [req-d03bfcc7-1838-4a18-9a68-b75c6f43d974 req-f51e9d9e-cbb1-4e99-9baf-49e8b538e576 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state active and task_state None.
Nov 16 19:44:39 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b529951e-831f-4bbe-8262-98862b956679 is timed out.
Nov 16 19:44:39 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance b529951e-831f-4bbe-8262-98862b956679 from the live domain config.
Nov 16 19:44:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHtvhuyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:39 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b213b-bd72-4757-8764-e2cef385e968]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:44:39 user nova-compute[86931]: No targets found.
Nov 16 19:44:39 user nova-compute[86931]: iSNS:
Nov 16 19:44:39 user nova-compute[86931]: No targets found.
Nov 16 19:44:39 user nova-compute[86931]: STATIC:
Nov 16 19:44:39 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db
Nov 16 19:44:39 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:44:39 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:44:39 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9
Nov 16 19:44:39 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:44:39 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:44:39 user nova-compute[86931]: FIRMWARE:
Nov 16 19:44:39 user nova-compute[86931]: No targets found.
Nov 16 19:44:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:44:39 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:44:39 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c354fa7-2f0c-4fbd-b6a8-456c620ee78f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec5ccc-1b91-4b75-b5ca-2c46c2ebf4ef]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:39 user nova-compute[86931]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db (non-flash)
Nov 16 19:44:39 user nova-compute[86931]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c4cf1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf3450e-2841-4277-88d2-7ce75e8f58c5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0220134e-50cf-4011-954d-b62077a9cdfc]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4982adc-1a8a-41f5-90a4-4f89aeec37b1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f58dbe-e809-4948-b71b-ab0f7d5e4286]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[37848d8f-6727-4334-ba84-0587a9860641]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ee610-8818-4d28-822a-a7dd25a2b585]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260]
Nov 16 19:44:39 user nova-compute[86931]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63c8c0e-ca4c-4663-843e-6a91b75de8db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[694728aa-8d95-4391-a678-1e3d935f9473]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== disconnect_volume: return (326ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-changed-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG nova.compute.manager [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Refreshing instance network info cache due to event network-changed-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] Acquiring lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] Acquired lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:44:39 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Refreshing network info cache for port a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:44:40 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updated VIF entry in instance network info cache for port a1d29bc9-d2c9-41d2-b640-e24981c4ae2a. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:44:40 user nova-compute[86931]: DEBUG nova.network.neutron [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updating instance_info_cache with network_info: [{"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:44:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8e1ca0ff-f39f-4655-b720-056418e6a65c req-e15d54fc-675a-4ebc-b684-223022b5611b service nova] Releasing lock "refresh_cache-f413e802-5663-4105-a13f-8f83cdb2db53" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:44:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31a1ab2f-db35-4c14-99c2-8440b0368798 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.024s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lazy-loading 'flavor' on Instance uuid f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:43 user nova-compute[86931]: INFO nova.compute.manager [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Attaching volume 4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 to /dev/vdb
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f269e76e-b48a-4d0e-83d2-da613576c6a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8320ebc-f4a6-4873-a2ff-9d69e7c9f2a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14d309-b9c6-4497-9d0a-ab2a3cb265e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa25db20-d75a-411e-b6db-1e0143dd2c61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:44:43 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:44:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca224786-a29f-4d50-a642-d8ff36a58553]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:43 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updating existing volume attachment record: 2cc3affc-5efd-45dd-843d-8c9b60dd5719 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:44:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRVWJOmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:44:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:44:48 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43aa788-58e6-426c-a9cd-8d5d5124a236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:44:48 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e7448-ecf7-4ff4-9b63-b0c4a0b638ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9] added
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c99888-d807-4065-8bb9-88159f32a649]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad749bfb-b5f7-4432-b816-e8f18d003058]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRVWJOmA {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRVWJOmA" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[96601fbb-07fd-487e-9202-2fe8a4e63cb4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRVWJOmA'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ac64a-9d88-4faf-8e8d-c44e7f705529]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5ac19-09c5-4daa-94d9-10b34c36440e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfaade-9f50-4765-9e78-b39ecdf64c49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260]
Nov 16 19:44:48 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260] successful.
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a6803-2256-4417-8ac4-6f79cecb98b0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51b075-eba8-4b51-98bb-6066fb0a394b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)
Nov 16 19:44:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b387d-811a-49da-91f6-d1faca591ba3]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:44:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRVWJOmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26632643963353730', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632643963353730', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG nova.objects.instance [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lazy-loading 'flavor' on Instance uuid f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:44:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:44:49 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:49 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:49 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:49 user nova-compute[86931]:   <serial>4edc6353-54ef-4bcd-9e3c-f2e85ee633b9</serial>
Nov 16 19:44:49 user nova-compute[86931]: </disk>
Nov 16 19:44:49 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:44:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:44:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] No VIF found with MAC fa:16:3e:9c:35:b1, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:44:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-8170ec47-13b5-43ec-888a-16a4af3051fa tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.967s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:52 user nova-compute[86931]: INFO nova.compute.manager [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Detaching volume 4edc6353-54ef-4bcd-9e3c-f2e85ee633b9
Nov 16 19:44:52 user nova-compute[86931]: INFO nova.virt.block_device [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Attempting to driver detach volume 4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 from mountpoint /dev/vdb
Nov 16 19:44:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Attempting to detach device vdb from instance f413e802-5663-4105-a13f-8f83cdb2db53 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:44:52 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:52 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:52 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:52 user nova-compute[86931]:   <serial>4edc6353-54ef-4bcd-9e3c-f2e85ee633b9</serial>
Nov 16 19:44:52 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:44:52 user nova-compute[86931]: </disk>
Nov 16 19:44:52 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:44:52 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Successfully detached device vdb from instance f413e802-5663-4105-a13f-8f83cdb2db53 from the persistent domain config.
Nov 16 19:44:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f413e802-5663-4105-a13f-8f83cdb2db53 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:44:52 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:44:52 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:44:52 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:44:52 user nova-compute[86931]:   <serial>4edc6353-54ef-4bcd-9e3c-f2e85ee633b9</serial>
Nov 16 19:44:52 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:44:52 user nova-compute[86931]: </disk>
Nov 16 19:44:52 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:44:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:44:53 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:44:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:44:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:57 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8216MB free_disk=25.076976776123047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b529951e-831f-4bbe-8262-98862b956679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance f413e802-5663-4105-a13f-8f83cdb2db53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:44:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:44:58 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:44:58 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:44:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:44:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:44:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:00 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:45:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:08 user nova-compute[86931]: INFO nova.compute.manager [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Terminating instance
Nov 16 19:45:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:45:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-unplugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] No waiting events found dispatching network-vif-unplugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-a5305ed6-2126-4ba8-b9e0-8225050e5184 req-4ac4b783-65d8-429a-b633-7a533e4d053a service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-unplugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b529951e-831f-4bbe-8262-98862b956679] Instance destroyed successfully.
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.objects.instance [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'resources' on Instance uuid b529951e-831f-4bbe-8262-98862b956679 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-216839388',display_name='tempest-AttachVolumeNegativeTest-server-216839388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-216839388',id=38,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaS822uHiMtEf6i4KxR5zkyFpLQoyGnWtnBKUp6ZE9mqKzKjVyjxgSwfCWYhCYWXdhzVv0klI7PpKChNUZdhMiZ4mpR9789kzn+gYC+tGHn5bWWik+joLygjROi88h5VQ==',key_name='tempest-keypair-1224297882',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-ysaabeuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b529951e-831f-4bbe-8262-98862b956679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "address": "fa:16:3e:f1:1d:b8", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f15ffa0-f6", "ovs_interfaceid": "6f15ffa0-f6a8-4200-b383-c1c65c147619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG os_vif [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f15ffa0-f6, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8bbac00-3332-42e7-a289-4bbf51bcdf0a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:09 user nova-compute[86931]: INFO os_vif [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:1d:b8,bridge_name='br-int',has_traffic_filtering=True,id=6f15ffa0-f6a8-4200-b383-c1c65c147619,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f15ffa0-f6')
Nov 16 19:45:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Deleting instance files /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679_del
Nov 16 19:45:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Deletion of /opt/stack/data/nova/instances/b529951e-831f-4bbe-8262-98862b956679_del complete
Nov 16 19:45:09 user nova-compute[86931]: INFO nova.compute.manager [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b529951e-831f-4bbe-8262-98862b956679] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 19:45:09 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: b529951e-831f-4bbe-8262-98862b956679] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:45:09 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b529951e-831f-4bbe-8262-98862b956679] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b529951e-831f-4bbe-8262-98862b956679] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:45:10 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: b529951e-831f-4bbe-8262-98862b956679] Took 0.84 seconds to deallocate network for instance.
Nov 16 19:45:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-6c21ed3c-9525-4c37-9528-034ab47e024a req-fe93c9de-ea03-4f10-8f3c-e7cf4b766df0 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-deleted-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:45:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:10 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Deleted allocations for instance b529951e-831f-4bbe-8262-98862b956679
Nov 16 19:45:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4b786c6e-b7d6-4dd7-9294-b5ed559450f1 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b529951e-831f-4bbe-8262-98862b956679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] Acquiring lock "b529951e-831f-4bbe-8262-98862b956679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] Lock "b529951e-831f-4bbe-8262-98862b956679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] No waiting events found dispatching network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:11 user nova-compute[86931]: WARNING nova.compute.manager [req-2c6b047b-5a14-496b-813d-766ca9a4c795 req-6c321eac-de24-4845-a9d1-a494710e42a3 service nova] [instance: b529951e-831f-4bbe-8262-98862b956679] Received unexpected event network-vif-plugged-6f15ffa0-f6a8-4200-b383-c1c65c147619 for instance with vm_state deleted and task_state None.
Nov 16 19:45:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:12 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f413e802-5663-4105-a13f-8f83cdb2db53 is timed out.
Nov 16 19:45:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Successfully detached device vdb from instance f413e802-5663-4105-a13f-8f83cdb2db53 from the live domain config.
Nov 16 19:45:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRVWJOmA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:45:12 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53acbc-eb4d-4bb9-958b-6a231df225d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:45:12 user nova-compute[86931]: No targets found.
Nov 16 19:45:12 user nova-compute[86931]: iSNS:
Nov 16 19:45:12 user nova-compute[86931]: No targets found.
Nov 16 19:45:12 user nova-compute[86931]: STATIC:
Nov 16 19:45:12 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9
Nov 16 19:45:12 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:45:12 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:45:12 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9
Nov 16 19:45:12 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:45:12 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:45:12 user nova-compute[86931]: FIRMWARE:
Nov 16 19:45:12 user nova-compute[86931]: No targets found.
Nov 16 19:45:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:45:12 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:45:12 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82451434-a75c-487c-be1f-b3a2a9e4ea38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[42843dc2-7557-4190-bf20-a9fb74be1a44]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:45:12 user nova-compute[86931]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)
Nov 16 19:45:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:45:12 user nova-compute[86931]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 (non-flash)
Nov 16 19:45:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24297f86-250e-4c85-a189-287b3707d0a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b373a-6568-44b4-9ff4-40b090d60494]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd0b816-970a-42e5-9286-784d9e7a2749]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:45:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfee56-6b58-4244-a12f-289c00817007]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[230598ef-e60b-43ec-a95c-1ba3571a50ee]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[463b388f-9249-4699-b3b5-7981dbe54e76]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260]
Nov 16 19:45:13 user nova-compute[86931]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9, portal: 172.16.0.220,3260] successful.
Nov 16 19:45:13 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4edc6353-54ef-4bcd-9e3c-f2e85ee633b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c0e450-04c3-4be7-9b8f-5965ee940213]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] <== disconnect_volume: return (274ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lazy-loading 'flavor' on Instance uuid f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-eac790c9-39fd-4dc9-975e-b8018dbca9df tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:45:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:27 user nova-compute[86931]: INFO nova.compute.manager [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Unshelving
Nov 16 19:45:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_requests' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'numa_topology' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:45:28 user nova-compute[86931]: INFO nova.compute.claims [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Claim successful on node user
Nov 16 19:45:28 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:45:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:28 user nova-compute[86931]: INFO nova.network.neutron [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating port 37051a47-6c49-45f9-a71d-8dd7d07beeeb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing instance network info cache due to event network-changed-37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] Acquiring lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:45:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Creating image(s)
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] Acquired lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.network.neutron [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Refreshing network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG nova.objects.base [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.part --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG nova.virt.images [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] 79aee1a2-7c33-4127-9cbd-206888d007e9 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.part /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG nova.network.neutron [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updated VIF entry in instance network info cache for port 37051a47-6c49-45f9-a71d-8dd7d07beeeb. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG nova.network.neutron [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:45:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3522c3e3-28a9-4833-b3e9-9f0d7e3cfc73 req-15aa72ed-2432-48f6-b802-bc4b9557f5b7 service nova] Releasing lock "refresh_cache-c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.part /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.converted" returned: 0 in 0.569s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.986s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8,backing_fmt=raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8,backing_fmt=raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk 1073741824" returned: 0 in 0.055s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "bbfacaed0bac32dbd84d7118038323800eddc2b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:32 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'migration_context' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:32 user nova-compute[86931]: DEBUG nova.objects.base [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:45:32 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Rebasing disk image.
Nov 16 19:45:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 -F raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 -F raw /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk" returned: 0 in 2.313s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Ensure instance console log exists: /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start _get_guest_xml network_info=[{"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='10df9870b3c3e4359e820451ba22908c',container_format='bare',created_at=2023-11-16T19:43:35Z,direct_url=<?>,disk_format='qcow2',id=79aee1a2-7c33-4127-9cbd-206888d007e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-961972779-shelved',owner='6184534338e74f3d827b9aee3e20c617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:43:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:45:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:45:34 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10df9870b3c3e4359e820451ba22908c',container_format='bare',created_at=2023-11-16T19:43:35Z,direct_url=<?>,disk_format='qcow2',id=79aee1a2-7c33-4127-9cbd-206888d007e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-961972779-shelved',owner='6184534338e74f3d827b9aee3e20c617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:43:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.objects.base [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='79aee1a2-7c33-4127-9cbd-206888d007e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-406939974',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:43:39.754037',shelved_host='user',shelved_image_id='79aee1a2-7c33-4127-9cbd-206888d007e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'pci_devices' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.objects.base [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Object Instance<c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:45:34 user nova-compute[86931]:   <uuid>c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</uuid>
Nov 16 19:45:34 user nova-compute[86931]:   <name>instance-00000025</name>
Nov 16 19:45:34 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:45:34 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:45:34 user nova-compute[86931]:   <metadata>
Nov 16 19:45:34 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:45:34 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-961972779</nova:name>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:45:34</nova:creationTime>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:45:34 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:45:34 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:owner>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:user uuid="a00a0387df984129850f1fb1e29a35ce">tempest-AttachVolumeShelveTestJSON-470403389-project-member</nova:user>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:project uuid="6184534338e74f3d827b9aee3e20c617">tempest-AttachVolumeShelveTestJSON-470403389</nova:project>
Nov 16 19:45:34 user nova-compute[86931]:       </nova:owner>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:root type="image" uuid="79aee1a2-7c33-4127-9cbd-206888d007e9"/>
Nov 16 19:45:34 user nova-compute[86931]:       <nova:ports>
Nov 16 19:45:34 user nova-compute[86931]:         <nova:port uuid="37051a47-6c49-45f9-a71d-8dd7d07beeeb">
Nov 16 19:45:34 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 19:45:34 user nova-compute[86931]:         </nova:port>
Nov 16 19:45:34 user nova-compute[86931]:       </nova:ports>
Nov 16 19:45:34 user nova-compute[86931]:     </nova:instance>
Nov 16 19:45:34 user nova-compute[86931]:   </metadata>
Nov 16 19:45:34 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:45:34 user nova-compute[86931]:     <system>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="serial">c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</entry>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="uuid">c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff</entry>
Nov 16 19:45:34 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:45:34 user nova-compute[86931]:     </system>
Nov 16 19:45:34 user nova-compute[86931]:   </sysinfo>
Nov 16 19:45:34 user nova-compute[86931]:   <os>
Nov 16 19:45:34 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:45:34 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:45:34 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:45:34 user nova-compute[86931]:   </os>
Nov 16 19:45:34 user nova-compute[86931]:   <features>
Nov 16 19:45:34 user nova-compute[86931]:     <acpi/>
Nov 16 19:45:34 user nova-compute[86931]:     <apic/>
Nov 16 19:45:34 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:45:34 user nova-compute[86931]:   </features>
Nov 16 19:45:34 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:45:34 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:45:34 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:45:34 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:45:34 user nova-compute[86931]:   </clock>
Nov 16 19:45:34 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:45:34 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:45:34 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:45:34 user nova-compute[86931]:   </cpu>
Nov 16 19:45:34 user nova-compute[86931]:   <devices>
Nov 16 19:45:34 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:45:34 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:45:34 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk"/>
Nov 16 19:45:34 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:45:34 user nova-compute[86931]:     </disk>
Nov 16 19:45:34 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:45:34 user nova-compute[86931]:       <mac address="fa:16:3e:b7:97:8e"/>
Nov 16 19:45:34 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:45:34 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:45:34 user nova-compute[86931]:       <target dev="tap37051a47-6c"/>
Nov 16 19:45:34 user nova-compute[86931]:     </interface>
Nov 16 19:45:34 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:45:34 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/console.log" append="off"/>
Nov 16 19:45:34 user nova-compute[86931]:     </serial>
Nov 16 19:45:34 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:45:34 user nova-compute[86931]:     <video>
Nov 16 19:45:34 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:45:34 user nova-compute[86931]:     </video>
Nov 16 19:45:34 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:45:34 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:45:34 user nova-compute[86931]:     </rng>
Nov 16 19:45:34 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:45:34 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:45:34 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:45:34 user nova-compute[86931]:     </memballoon>
Nov 16 19:45:34 user nova-compute[86931]:   </devices>
Nov 16 19:45:34 user nova-compute[86931]: </domain>
Nov 16 19:45:34 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='79aee1a2-7c33-4127-9cbd-206888d007e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-406939974',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member',shelved_at='2023-11-16T19:43:39.754037',shelved_host='user',shelved_image_id='79aee1a2-7c33-4127-9cbd-206888d007e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG os_vif [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e530e409-6e67-577e-b9b6-fbda5f30b2ad', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37051a47-6c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37051a47-6c, col_values=(('qos', UUID('200a7d48-f90d-4b35-bcd9-a7bd4a69cf75')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37051a47-6c, col_values=(('external_ids', {'iface-id': '37051a47-6c49-45f9-a71d-8dd7d07beeeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:97:8e', 'vm-uuid': 'c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:34 user nova-compute[86931]: INFO os_vif [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c')
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:45:34 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] No VIF found with MAC fa:16:3e:b7:97:8e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG nova.compute.manager [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:36 user nova-compute[86931]: WARNING nova.compute.manager [req-60fab523-e790-455d-bfed-d69adb6b09f3 req-65584ead-e409-418b-87f5-27d6cbd63d8a service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:45:38 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance spawned successfully.
Nov 16 19:45:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:38 user nova-compute[86931]: WARNING nova.compute.manager [req-1858d674-1f94-4315-8e14-f7f4bd636c42 req-c7fa53ca-1096-4939-9d5f-ec78077afe03 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 19:45:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:45:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3e413ef9-e64c-46b9-9c6c-ab77ce017c46 tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.644s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:44 user nova-compute[86931]: INFO nova.compute.manager [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Terminating instance
Nov 16 19:45:44 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:45:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-unplugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] No waiting events found dispatching network-vif-unplugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-be6f62a8-b9f9-482e-8045-c93c4e423ad8 req-9019886a-8ee4-4908-b054-22c8e8c92e24 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-unplugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:45:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Instance destroyed successfully.
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lazy-loading 'resources' on Instance uuid f413e802-5663-4105-a13f-8f83cdb2db53 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-290626847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2906268',id=40,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUQ8QGZ290TMCoPpNhqODgjOqS3DXKm2gHmKnt3omLhKpRXyOs+viWXe1MlrXfzdtylmOnUP4QyQb7JLc+MGooVKbXobxghInliHx5MSGEtEtphyWRAKWlB3H1rwV/MKg==',key_name='tempest-keypair-1081784419',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aef3ed7bde1486196bbdd36846f268b',ramdisk_id='',reservation_id='r-izwl2nsw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:42:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7102aa365a7d4bfd96e0bc0a15047405',uuid=f413e802-5663-4105-a13f-8f83cdb2db53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converting VIF {"id": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "address": "fa:16:3e:9c:35:b1", "network": {"id": "9dce60e5-20c1-4686-85ea-9f52a0f993df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-226013744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aef3ed7bde1486196bbdd36846f268b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1d29bc9-d2", "ovs_interfaceid": "a1d29bc9-d2c9-41d2-b640-e24981c4ae2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG os_vif [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1d29bc9-d2, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2546269-6806-49f7-a029-702ef62828c1) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:45:45 user nova-compute[86931]: INFO os_vif [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:35:b1,bridge_name='br-int',has_traffic_filtering=True,id=a1d29bc9-d2c9-41d2-b640-e24981c4ae2a,network=Network(9dce60e5-20c1-4686-85ea-9f52a0f993df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1d29bc9-d2')
Nov 16 19:45:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Deleting instance files /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53_del
Nov 16 19:45:45 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Deletion of /opt/stack/data/nova/instances/f413e802-5663-4105-a13f-8f83cdb2db53_del complete
Nov 16 19:45:45 user nova-compute[86931]: INFO nova.compute.manager [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 19:45:45 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:45:45 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:45:46 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Took 0.72 seconds to deallocate network for instance.
Nov 16 19:45:46 user nova-compute[86931]: DEBUG nova.compute.manager [req-c5b7c996-a2b0-4f71-a018-66e6f3076887 req-1632823e-58ca-44c7-8db8-f0ccfcd2d1a4 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-deleted-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:45:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:46 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Deleted allocations for instance f413e802-5663-4105-a13f-8f83cdb2db53
Nov 16 19:45:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e1be9bf4-efc5-432b-b329-9945b48182e6 tempest-TestServerVolumeAttachScenarioOldVersion-327141478 tempest-TestServerVolumeAttachScenarioOldVersion-327141478-project-member] Lock "f413e802-5663-4105-a13f-8f83cdb2db53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:45:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] Acquiring lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] Lock "f413e802-5663-4105-a13f-8f83cdb2db53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] No waiting events found dispatching network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:45:47 user nova-compute[86931]: WARNING nova.compute.manager [req-da8dd42d-beaa-4917-8197-60567714a606 req-409b2edb-6683-473e-9d9d-1e95a68cbf31 service nova] [instance: f413e802-5663-4105-a13f-8f83cdb2db53] Received unexpected event network-vif-plugged-a1d29bc9-d2c9-41d2-b640-e24981c4ae2a for instance with vm_state deleted and task_state None.
Nov 16 19:45:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:54 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:55 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:45:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:45:58 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:45:58 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.104896545410156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:45:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:46:03 user nova-compute[86931]: INFO nova.compute.claims [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Claim successful on node user
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:46:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.policy [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7112607a7774345b8879d0422b8b94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3ee3cb7b348423c81c90a733038d9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:46:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Creating image(s)
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "/opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "/opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk 1073741824" returned: 0 in 0.051s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Successfully created port: b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Cannot resize image /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Ensure instance console log exists: /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Successfully updated port: b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquired lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-changed-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Refreshing instance network info cache due to event network-changed-b73f9a93-75e7-4352-a39c-0c27af9ada60. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] Acquiring lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updating instance_info_cache with network_info: [{"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Releasing lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Instance network_info: |[{"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] Acquired lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Refreshing network info cache for port b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Start _get_guest_xml network_info=[{"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:46:05 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:46:05 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1509837353',display_name='tempest-AttachVolumeNegativeTest-server-1509837353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1509837353',id=42,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSjEOQTSdQG174Zr6eoO6mHm0AuwbV6/OB+oRkf8KppfsWKEMaAH7eF3k6SGGKiP/yph1jqrHadVCPZTIj9EzkTcnrePlfgLPOZ8obL6mMQnB85lRvpK7BkaXpTJJr8pA==',key_name='tempest-keypair-65602087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-rmefd7ci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b618955e-fec4-4b7f-9664-979d864e51ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.objects.instance [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'pci_devices' on Instance uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:46:05 user nova-compute[86931]:   <uuid>b618955e-fec4-4b7f-9664-979d864e51ca</uuid>
Nov 16 19:46:05 user nova-compute[86931]:   <name>instance-0000002a</name>
Nov 16 19:46:05 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:46:05 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:46:05 user nova-compute[86931]:   <metadata>
Nov 16 19:46:05 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:46:05 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1509837353</nova:name>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:46:05</nova:creationTime>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:46:05 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:46:05 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:owner>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:user uuid="d7112607a7774345b8879d0422b8b94c">tempest-AttachVolumeNegativeTest-57450610-project-member</nova:user>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:project uuid="a3ee3cb7b348423c81c90a733038d9ff">tempest-AttachVolumeNegativeTest-57450610</nova:project>
Nov 16 19:46:05 user nova-compute[86931]:       </nova:owner>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:46:05 user nova-compute[86931]:       <nova:ports>
Nov 16 19:46:05 user nova-compute[86931]:         <nova:port uuid="b73f9a93-75e7-4352-a39c-0c27af9ada60">
Nov 16 19:46:05 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 19:46:05 user nova-compute[86931]:         </nova:port>
Nov 16 19:46:05 user nova-compute[86931]:       </nova:ports>
Nov 16 19:46:05 user nova-compute[86931]:     </nova:instance>
Nov 16 19:46:05 user nova-compute[86931]:   </metadata>
Nov 16 19:46:05 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:46:05 user nova-compute[86931]:     <system>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="serial">b618955e-fec4-4b7f-9664-979d864e51ca</entry>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="uuid">b618955e-fec4-4b7f-9664-979d864e51ca</entry>
Nov 16 19:46:05 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:46:05 user nova-compute[86931]:     </system>
Nov 16 19:46:05 user nova-compute[86931]:   </sysinfo>
Nov 16 19:46:05 user nova-compute[86931]:   <os>
Nov 16 19:46:05 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:46:05 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:46:05 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:46:05 user nova-compute[86931]:   </os>
Nov 16 19:46:05 user nova-compute[86931]:   <features>
Nov 16 19:46:05 user nova-compute[86931]:     <acpi/>
Nov 16 19:46:05 user nova-compute[86931]:     <apic/>
Nov 16 19:46:05 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:46:05 user nova-compute[86931]:   </features>
Nov 16 19:46:05 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:46:05 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:46:05 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:46:05 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:46:05 user nova-compute[86931]:   </clock>
Nov 16 19:46:05 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:46:05 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:46:05 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:46:05 user nova-compute[86931]:   </cpu>
Nov 16 19:46:05 user nova-compute[86931]:   <devices>
Nov 16 19:46:05 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:46:05 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:46:05 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk"/>
Nov 16 19:46:05 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:46:05 user nova-compute[86931]:     </disk>
Nov 16 19:46:05 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:46:05 user nova-compute[86931]:       <mac address="fa:16:3e:16:d7:45"/>
Nov 16 19:46:05 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:46:05 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:46:05 user nova-compute[86931]:       <target dev="tapb73f9a93-75"/>
Nov 16 19:46:05 user nova-compute[86931]:     </interface>
Nov 16 19:46:05 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:46:05 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/console.log" append="off"/>
Nov 16 19:46:05 user nova-compute[86931]:     </serial>
Nov 16 19:46:05 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:46:05 user nova-compute[86931]:     <video>
Nov 16 19:46:05 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:46:05 user nova-compute[86931]:     </video>
Nov 16 19:46:05 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:46:05 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:46:05 user nova-compute[86931]:     </rng>
Nov 16 19:46:05 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:46:05 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:46:05 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:46:05 user nova-compute[86931]:     </memballoon>
Nov 16 19:46:05 user nova-compute[86931]:   </devices>
Nov 16 19:46:05 user nova-compute[86931]: </domain>
Nov 16 19:46:05 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1509837353',display_name='tempest-AttachVolumeNegativeTest-server-1509837353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1509837353',id=42,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSjEOQTSdQG174Zr6eoO6mHm0AuwbV6/OB+oRkf8KppfsWKEMaAH7eF3k6SGGKiP/yph1jqrHadVCPZTIj9EzkTcnrePlfgLPOZ8obL6mMQnB85lRvpK7BkaXpTJJr8pA==',key_name='tempest-keypair-65602087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-rmefd7ci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b618955e-fec4-4b7f-9664-979d864e51ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG os_vif [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20415afc-6654-59c1-a691-640734259392', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73f9a93-75, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73f9a93-75, col_values=(('qos', UUID('af0acfd9-f5c4-4470-a900-2e469a7a986a')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73f9a93-75, col_values=(('external_ids', {'iface-id': 'b73f9a93-75e7-4352-a39c-0c27af9ada60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:d7:45', 'vm-uuid': 'b618955e-fec4-4b7f-9664-979d864e51ca'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:05 user nova-compute[86931]: INFO os_vif [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75')
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:16:d7:45, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updated VIF entry in instance network info cache for port b73f9a93-75e7-4352-a39c-0c27af9ada60. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG nova.network.neutron [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updating instance_info_cache with network_info: [{"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6280cdfb-a8c8-478f-a362-c820dddee1f6 req-c8719bb4-056d-4292-85fb-615315c182c7 service nova] Releasing lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] No waiting events found dispatching network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:06 user nova-compute[86931]: WARNING nova.compute.manager [req-451e8882-0692-4ce0-82a2-bbdfd42ac0c3 req-2ab2d48d-a5f8-47df-be8d-d8ca0600301d service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received unexpected event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 for instance with vm_state building and task_state spawning.
Nov 16 19:46:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:46:08 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Instance spawned successfully.
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:46:09 user nova-compute[86931]: INFO nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 19:46:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:46:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] No waiting events found dispatching network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:09 user nova-compute[86931]: WARNING nova.compute.manager [req-9e45ec94-7400-42f0-90c8-17a1fea6e3d2 req-a0e1f5bb-31ed-4c7c-a770-ed7b9ebe3459 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received unexpected event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 for instance with vm_state building and task_state spawning.
Nov 16 19:46:09 user nova-compute[86931]: INFO nova.compute.manager [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Took 5.71 seconds to build instance.
Nov 16 19:46:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-91dd60b0-8b28-40bd-842a-49bdcdbe3712 tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.809s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing instance network info cache due to event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'flavor' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updated VIF entry in instance network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:16 user nova-compute[86931]: INFO nova.compute.manager [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Attaching volume a5600178-a3a7-4258-bb35-77da4e186ccd to /dev/vdb
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-766bd6d5-1374-4dc7-8794-3fe8958c8518 req-61f794ec-5ca7-4435-bba0-5dc4e9f9ee4a service nova] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.utils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f294d97-e04e-405b-bbc0-af0d554f7c56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[959a110a-f390-4375-b52c-f8acb7d853bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e19493-b30b-4507-81a4-59c56b799686]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[482fa03e-2bb8-49a5-88d9-fa4a5b7dbc77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:46:16 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:46:16 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc36efc-f872-42fe-994d-c5a1a8ddeb63]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG os_brick.utils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:46:16 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating existing volume attachment record: 6cf29d5d-df22-4251-81b2-9810b7864244 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:46:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuXsqDFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:46:21 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:46:21 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:46:21 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a454ded8-497e-44a0-a976-369ab48c86f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:46:21 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.046s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d98bf-e7f6-4923-9dec-9186a23ba96c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd] added
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43354c8-14ef-4ef4-ba53-680dd2b420f0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[35682e21-b330-4b92-b69f-16b0f9609638]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuXsqDFw {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuXsqDFw" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[526be729-a97a-43fc-905c-6d8ed42c13d5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zuXsqDFw'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9b839-3cc6-4d7e-8fc1-6961047570c4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86640ce8-628b-4de1-be47-1001bbafa2b7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bdb1d8-baff-4780-9c69-545b5a189f58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260]
Nov 16 19:46:21 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260] successful.
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a6246-b186-494c-8e5c-ea8c8f219cef]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64126b9-fb35-4668-b93e-6bfe0406c056]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:21 user nova-compute[86931]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:21 user nova-compute[86931]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:46:21 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fe059-4f43-4e54-bb22-f7ee5776e449]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:21 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing instance network info cache due to event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updated VIF entry in instance network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.network.neutron [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eed9d237-19c0-4468-83c2-c8053e2f54c5 req-ec654e1a-84c5-49f6-9b00-94f5bc5a7e08 service nova] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuXsqDFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23838636531366630', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838636531366630', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'flavor' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:46:22 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:46:22 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:46:22 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:46:22 user nova-compute[86931]:   <serial>a5600178-a3a7-4258-bb35-77da4e186ccd</serial>
Nov 16 19:46:22 user nova-compute[86931]: </disk>
Nov 16 19:46:22 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:fe:9d:3d, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b34a54f-7b13-424a-afb5-8e131bdc6590 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.950s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing instance network info cache due to event network-changed-eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Refreshing network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:23 user nova-compute[86931]: INFO nova.compute.manager [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Detaching volume d10540c1-c577-416b-b316-954e8e9fcce9
Nov 16 19:46:23 user nova-compute[86931]: INFO nova.virt.block_device [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Attempting to driver detach volume d10540c1-c577-416b-b316-954e8e9fcce9 from mountpoint /dev/vdb
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Attempting to detach device vdb from instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:46:23 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:46:23 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:46:23 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:46:23 user nova-compute[86931]:   <serial>d10540c1-c577-416b-b316-954e8e9fcce9</serial>
Nov 16 19:46:23 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:46:23 user nova-compute[86931]: </disk>
Nov 16 19:46:23 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:46:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully detached device vdb from instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e from the persistent domain config.
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:46:23 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:46:23 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:46:23 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:46:23 user nova-compute[86931]:   <serial>d10540c1-c577-416b-b316-954e8e9fcce9</serial>
Nov 16 19:46:23 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 19:46:23 user nova-compute[86931]: </disk>
Nov 16 19:46:23 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updated VIF entry in instance network info cache for port eb225ebc-09ef-4f94-8f7a-19d247eae018. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.network.neutron [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-42bd4b12-4361-4313-b570-191b6ac0a1ac req-70306bc8-22c4-407a-a0b7-d4aa4f036510 service nova] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:46:24 user nova-compute[86931]: INFO nova.compute.manager [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Rescuing
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:24 user nova-compute[86931]: WARNING nova.compute.manager [req-60ff0023-a8a4-4488-baa3-4842010afd86 req-be694add-9ec0-4b3c-9eeb-fc7858449437 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state active and task_state rescuing.
Nov 16 19:46:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance destroyed successfully.
Nov 16 19:46:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Attempting rescue
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=86931) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance directory exists: not creating {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 19:46:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Creating image(s)
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'trusted_certs' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue" returned: 0 in 0.046s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'migration_context' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.base [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<d583241c-7b40-4992-9e0a-c4c190bace16> lazy-loaded attributes: trusted_certs,migration_context {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start _get_guest_xml network_info=[{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:fe:9d:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.base [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<d583241c-7b40-4992-9e0a-c4c190bace16> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'numa_topology' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.base [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<d583241c-7b40-4992-9e0a-c4c190bace16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:46:25 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:46:25 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'vcpu_model' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.base [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<d583241c-7b40-4992-9e0a-c4c190bace16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377330977',display_name='tempest-ServerRescueNegativeTestJSON-server-377330977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377330977',id=41,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NN1l2qf2xJjcg1t0BcGxbpaM8vD8QOkYUurVG3LnhyEyzz/V0KnWj/SkfCqnPCaZOw9thL8mPJEhxJX7eohj4snwi8wMsTlbFlS1bVRp+FSodAPNx2qPpScQvT6rMag==',key_name='tempest-keypair-767497068',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:44:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-tqzj16uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=d583241c-7b40-4992-9e0a-c4c190bace16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:fe:9d:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "vif_mac": "fa:16:3e:fe:9d:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'pci_devices' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.objects.base [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Object Instance<d583241c-7b40-4992-9e0a-c4c190bace16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:46:25 user nova-compute[86931]:   <uuid>d583241c-7b40-4992-9e0a-c4c190bace16</uuid>
Nov 16 19:46:25 user nova-compute[86931]:   <name>instance-00000029</name>
Nov 16 19:46:25 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:46:25 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:46:25 user nova-compute[86931]:   <metadata>
Nov 16 19:46:25 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:46:25 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377330977</nova:name>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:46:25</nova:creationTime>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:46:25 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:46:25 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:owner>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:user uuid="51a6c7bcc5a54d819a6cfa7187229c06">tempest-ServerRescueNegativeTestJSON-714133090-project-member</nova:user>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:project uuid="8c44cf782aee484eb908f5e0d1a348f9">tempest-ServerRescueNegativeTestJSON-714133090</nova:project>
Nov 16 19:46:25 user nova-compute[86931]:       </nova:owner>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:46:25 user nova-compute[86931]:       <nova:ports>
Nov 16 19:46:25 user nova-compute[86931]:         <nova:port uuid="a0d90ba0-4f69-49ee-88bf-3833b772bd0e">
Nov 16 19:46:25 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:46:25 user nova-compute[86931]:         </nova:port>
Nov 16 19:46:25 user nova-compute[86931]:       </nova:ports>
Nov 16 19:46:25 user nova-compute[86931]:     </nova:instance>
Nov 16 19:46:25 user nova-compute[86931]:   </metadata>
Nov 16 19:46:25 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:46:25 user nova-compute[86931]:     <system>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="serial">d583241c-7b40-4992-9e0a-c4c190bace16</entry>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="uuid">d583241c-7b40-4992-9e0a-c4c190bace16</entry>
Nov 16 19:46:25 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:46:25 user nova-compute[86931]:     </system>
Nov 16 19:46:25 user nova-compute[86931]:   </sysinfo>
Nov 16 19:46:25 user nova-compute[86931]:   <os>
Nov 16 19:46:25 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:46:25 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:46:25 user nova-compute[86931]:   </os>
Nov 16 19:46:25 user nova-compute[86931]:   <features>
Nov 16 19:46:25 user nova-compute[86931]:     <acpi/>
Nov 16 19:46:25 user nova-compute[86931]:     <apic/>
Nov 16 19:46:25 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:46:25 user nova-compute[86931]:   </features>
Nov 16 19:46:25 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:46:25 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:46:25 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:46:25 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:46:25 user nova-compute[86931]:   </clock>
Nov 16 19:46:25 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:46:25 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:46:25 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:46:25 user nova-compute[86931]:   </cpu>
Nov 16 19:46:25 user nova-compute[86931]:   <devices>
Nov 16 19:46:25 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:46:25 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:46:25 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue"/>
Nov 16 19:46:25 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:46:25 user nova-compute[86931]:     </disk>
Nov 16 19:46:25 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:46:25 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:46:25 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk"/>
Nov 16 19:46:25 user nova-compute[86931]:       <target dev="vdb" bus="virtio"/>
Nov 16 19:46:25 user nova-compute[86931]:     </disk>
Nov 16 19:46:25 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:46:25 user nova-compute[86931]:       <mac address="fa:16:3e:fe:9d:3d"/>
Nov 16 19:46:25 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:46:25 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:46:25 user nova-compute[86931]:       <target dev="tapa0d90ba0-4f"/>
Nov 16 19:46:25 user nova-compute[86931]:     </interface>
Nov 16 19:46:25 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:46:25 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/console.log" append="off"/>
Nov 16 19:46:25 user nova-compute[86931]:     </serial>
Nov 16 19:46:25 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:46:25 user nova-compute[86931]:     <video>
Nov 16 19:46:25 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:46:25 user nova-compute[86931]:     </video>
Nov 16 19:46:25 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:46:25 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:46:25 user nova-compute[86931]:     </rng>
Nov 16 19:46:25 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:46:25 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:46:25 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:46:25 user nova-compute[86931]:     </memballoon>
Nov 16 19:46:25 user nova-compute[86931]:   </devices>
Nov 16 19:46:25 user nova-compute[86931]: </domain>
Nov 16 19:46:25 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:46:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance destroyed successfully.
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:46:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] No VIF found with MAC fa:16:3e:fe:9d:3d, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:46:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:26 user nova-compute[86931]: WARNING nova.compute.manager [req-6381952e-ac58-4a7e-a58d-ef841b95b88e req-72292889-9744-4481-b4b8-db495345fdfd service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state active and task_state rescuing.
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:28 user nova-compute[86931]: WARNING nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state active and task_state rescuing.
Nov 16 19:46:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:46:28 user nova-compute[86931]: WARNING nova.compute.manager [req-679588f1-67e6-4a9e-b10f-2509bad6c90b req-63ac8105-023f-406e-b67c-a114f53ed6ea service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state active and task_state rescuing.
Nov 16 19:46:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-451fee4f-c786-4121-97de-3184cfd9df89 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:46:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:43 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e is timed out.
Nov 16 19:46:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully detached device vdb from instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e from the live domain config.
Nov 16 19:46:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:46:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKoMsZxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:46:43 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:46:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:46:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:46:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e66174-6bab-4366-b47a-33910d1a82a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:46:44 user nova-compute[86931]: No targets found.
Nov 16 19:46:44 user nova-compute[86931]: iSNS:
Nov 16 19:46:44 user nova-compute[86931]: No targets found.
Nov 16 19:46:44 user nova-compute[86931]: STATIC:
Nov 16 19:46:44 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd
Nov 16 19:46:44 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:46:44 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:46:44 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9
Nov 16 19:46:44 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:46:44 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:46:44 user nova-compute[86931]: FIRMWARE:
Nov 16 19:46:44 user nova-compute[86931]: No targets found.
Nov 16 19:46:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:46:44 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:46:44 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae349075-507d-4e34-b4af-3bf90c6adcae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e66a20-4913-45a3-9191-96e33979e33e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:44 user nova-compute[86931]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:46:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 (non-flash)
Nov 16 19:46:44 user nova-compute[86931]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:46:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5237f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[658bcd79-b4f4-4208-a6c6-ec1d438978e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572f01f-138a-4912-a2b8-82e593de50f4]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50857ad1-7912-4ef3-9d98-7f4273d83af0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[33630bb6-cee9-48a6-a9ce-c7386844801f]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc6a29-4738-4a70-a6c3-7fbeb609fc7e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b38e77a-8da6-4ff8-a1f3-0e5ed12a371a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260]
Nov 16 19:46:44 user nova-compute[86931]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9, portal: 172.16.0.220,3260] successful.
Nov 16 19:46:44 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10540c1-c577-416b-b316-954e8e9fcce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[59031962-c3af-4e47-8675-3d7a419709f8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== disconnect_volume: return (313ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:46:44 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:46:45 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:46:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2178f58c-f40d-46b0-98a1-29d090a7d0ec tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:46:58 user nova-compute[86931]: INFO nova.compute.claims [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Claim successful on node user
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:46:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.policy [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29c96fafdf954320a248fe70ccbecebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466675c1e7a14722b6356d73101daa85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:46:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Creating image(s)
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "/opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "/opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "/opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk 1073741824" returned: 0 in 0.052s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Successfully created port: 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Checking if we can resize image /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:46:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Cannot resize image /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Ensure instance console log exists: /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Successfully updated port: 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing instance network info cache due to event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing network info cache for port 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:47:00 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:47:00 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8216MB free_disk=25.071773529052734GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b618955e-fec4-4b7f-9664-979d864e51ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:47:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.neutron [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a4cf3b66-aa64-4004-b135-b21e81e93527 req-35a662bd-9171-435b-bba5-ea40c04d200f service nova] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.neutron [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance network_info: |[{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Start _get_guest_xml network_info=[{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:47:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:47:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-206850242',display_name='tempest-TestStampPattern-server-206850242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-206850242',id=43,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-ug70fvyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:46:59Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=925365ff-8012-467e-a0f4-19b29b36498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'pci_devices' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:47:01 user nova-compute[86931]:   <uuid>925365ff-8012-467e-a0f4-19b29b36498d</uuid>
Nov 16 19:47:01 user nova-compute[86931]:   <name>instance-0000002b</name>
Nov 16 19:47:01 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:47:01 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:47:01 user nova-compute[86931]:   <metadata>
Nov 16 19:47:01 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:47:01 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:name>tempest-TestStampPattern-server-206850242</nova:name>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:47:01</nova:creationTime>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:47:01 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:47:01 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:owner>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:user uuid="29c96fafdf954320a248fe70ccbecebe">tempest-TestStampPattern-2080453112-project-member</nova:user>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:project uuid="466675c1e7a14722b6356d73101daa85">tempest-TestStampPattern-2080453112</nova:project>
Nov 16 19:47:01 user nova-compute[86931]:       </nova:owner>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:47:01 user nova-compute[86931]:       <nova:ports>
Nov 16 19:47:01 user nova-compute[86931]:         <nova:port uuid="3a6be0a8-7f0d-46ad-b448-72b0a75e85bc">
Nov 16 19:47:01 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 19:47:01 user nova-compute[86931]:         </nova:port>
Nov 16 19:47:01 user nova-compute[86931]:       </nova:ports>
Nov 16 19:47:01 user nova-compute[86931]:     </nova:instance>
Nov 16 19:47:01 user nova-compute[86931]:   </metadata>
Nov 16 19:47:01 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:47:01 user nova-compute[86931]:     <system>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="serial">925365ff-8012-467e-a0f4-19b29b36498d</entry>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="uuid">925365ff-8012-467e-a0f4-19b29b36498d</entry>
Nov 16 19:47:01 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:47:01 user nova-compute[86931]:     </system>
Nov 16 19:47:01 user nova-compute[86931]:   </sysinfo>
Nov 16 19:47:01 user nova-compute[86931]:   <os>
Nov 16 19:47:01 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:47:01 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:47:01 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:47:01 user nova-compute[86931]:   </os>
Nov 16 19:47:01 user nova-compute[86931]:   <features>
Nov 16 19:47:01 user nova-compute[86931]:     <acpi/>
Nov 16 19:47:01 user nova-compute[86931]:     <apic/>
Nov 16 19:47:01 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:47:01 user nova-compute[86931]:   </features>
Nov 16 19:47:01 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:47:01 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:47:01 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:47:01 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:47:01 user nova-compute[86931]:   </clock>
Nov 16 19:47:01 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:47:01 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:47:01 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:47:01 user nova-compute[86931]:   </cpu>
Nov 16 19:47:01 user nova-compute[86931]:   <devices>
Nov 16 19:47:01 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:47:01 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:47:01 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk"/>
Nov 16 19:47:01 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:47:01 user nova-compute[86931]:     </disk>
Nov 16 19:47:01 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:47:01 user nova-compute[86931]:       <mac address="fa:16:3e:d7:a3:f6"/>
Nov 16 19:47:01 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:47:01 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:47:01 user nova-compute[86931]:       <target dev="tap3a6be0a8-7f"/>
Nov 16 19:47:01 user nova-compute[86931]:     </interface>
Nov 16 19:47:01 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:47:01 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/console.log" append="off"/>
Nov 16 19:47:01 user nova-compute[86931]:     </serial>
Nov 16 19:47:01 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:47:01 user nova-compute[86931]:     <video>
Nov 16 19:47:01 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:47:01 user nova-compute[86931]:     </video>
Nov 16 19:47:01 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:47:01 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:47:01 user nova-compute[86931]:     </rng>
Nov 16 19:47:01 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:47:01 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:47:01 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:47:01 user nova-compute[86931]:     </memballoon>
Nov 16 19:47:01 user nova-compute[86931]:   </devices>
Nov 16 19:47:01 user nova-compute[86931]: </domain>
Nov 16 19:47:01 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-206850242',display_name='tempest-TestStampPattern-server-206850242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-206850242',id=43,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-ug70fvyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:46:59Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=925365ff-8012-467e-a0f4-19b29b36498d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG os_vif [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9467985-b460-5a69-9efe-e53be961b3fa', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a6be0a8-7f, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a6be0a8-7f, col_values=(('qos', UUID('c4d0c83e-1100-452a-9c0c-6702b5f65761')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a6be0a8-7f, col_values=(('external_ids', {'iface-id': '3a6be0a8-7f0d-46ad-b448-72b0a75e85bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:a3:f6', 'vm-uuid': '925365ff-8012-467e-a0f4-19b29b36498d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:01 user nova-compute[86931]: INFO os_vif [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f')
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:47:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No VIF found with MAC fa:16:3e:d7:a3:f6, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:02 user nova-compute[86931]: DEBUG nova.compute.manager [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] No waiting events found dispatching network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:02 user nova-compute[86931]: WARNING nova.compute.manager [req-edcb6da9-884e-478d-a354-7e17781eb7fa req-8d62514b-029b-4359-819f-a49675f43085 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received unexpected event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc for instance with vm_state building and task_state spawning.
Nov 16 19:47:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:47:03 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [{"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-114766b0-9ff3-40f6-bd7d-e6694c8acf4e" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:47:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance spawned successfully.
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:47:05 user nova-compute[86931]: INFO nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 16 19:47:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:47:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] No waiting events found dispatching network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:05 user nova-compute[86931]: WARNING nova.compute.manager [req-274e40ee-a62b-4f96-94ac-d8dfb7491e61 req-5052547a-b114-4087-af44-41808a748b7b service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received unexpected event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc for instance with vm_state building and task_state spawning.
Nov 16 19:47:05 user nova-compute[86931]: INFO nova.compute.manager [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Took 6.39 seconds to build instance.
Nov 16 19:47:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c54024b9-4a7e-4e1c-b274-4a44984ed447 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.489s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:16 user nova-compute[86931]: INFO nova.compute.manager [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Terminating instance
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-e047da7e-2190-4ec0-96d3-bf89e49c6984 req-f4c8ff7a-7309-4ba6-922e-2646a7193a06 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-unplugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Instance destroyed successfully.
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'resources' on Instance uuid 114766b0-9ff3-40f6-bd7d-e6694c8acf4e {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-839705922',display_name='tempest-TestMinimumBasicScenario-server-839705922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-839705922',id=39,image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8ASg0YbI4ucxoU+5g4CxobaeM3nqMygWLMo3PGmFXNS0uUbjz9xX8Oj6gj8A5e40jtvvPXdNKmWEb2+ZwhiLHYskAB5W4N+WApzdZpJvIFbWgXdpdL3prrdGbzaAaYgQ==',key_name='tempest-TestMinimumBasicScenario-117720575',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-lojbh4hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='49c32d05-c48f-40bc-8b83-d49811dc92e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:44:38Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=114766b0-9ff3-40f6-bd7d-e6694c8acf4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "address": "fa:16:3e:8e:81:9e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb225ebc-09", "ovs_interfaceid": "eb225ebc-09ef-4f94-8f7a-19d247eae018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG os_vif [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb225ebc-09, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbd7d01a-0138-4f2c-a093-9ee3e969d5af) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:16 user nova-compute[86931]: INFO os_vif [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=eb225ebc-09ef-4f94-8f7a-19d247eae018,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb225ebc-09')
Nov 16 19:47:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Deleting instance files /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e_del
Nov 16 19:47:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Deletion of /opt/stack/data/nova/instances/114766b0-9ff3-40f6-bd7d-e6694c8acf4e_del complete
Nov 16 19:47:17 user nova-compute[86931]: INFO nova.compute.manager [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 19:47:17 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-df46063b-1132-43a0-8f28-430c19689947 req-72604f41-280e-462d-a2cd-0d62d07c4fd4 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-deleted-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:17 user nova-compute[86931]: INFO nova.compute.manager [req-df46063b-1132-43a0-8f28-430c19689947 req-72604f41-280e-462d-a2cd-0d62d07c4fd4 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Neutron deleted interface eb225ebc-09ef-4f94-8f7a-19d247eae018; detaching it from the instance and deleting it from the info cache
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.network.neutron [req-df46063b-1132-43a0-8f28-430c19689947 req-72604f41-280e-462d-a2cd-0d62d07c4fd4 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:17 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Took 0.79 seconds to deallocate network for instance.
Nov 16 19:47:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-df46063b-1132-43a0-8f28-430c19689947 req-72604f41-280e-462d-a2cd-0d62d07c4fd4 service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Detach interface failed, port_id=eb225ebc-09ef-4f94-8f7a-19d247eae018, reason: Instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.compute.manager [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Terminating instance
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Deleted allocations for instance 114766b0-9ff3-40f6-bd7d-e6694c8acf4e
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-a49069f2-49a5-46ea-9326-139d88bd9184 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.226s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Acquiring lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Lock "114766b0-9ff3-40f6-bd7d-e6694c8acf4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] No waiting events found dispatching network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:18 user nova-compute[86931]: WARNING nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: 114766b0-9ff3-40f6-bd7d-e6694c8acf4e] Received unexpected event network-vif-plugged-eb225ebc-09ef-4f94-8f7a-19d247eae018 for instance with vm_state deleted and task_state None.
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [req-f6bb6ec4-0a7e-482b-adfa-1b49a98a5d53 req-3d6c5bbf-eaf1-4923-a967-2e349a1f990f service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Instance destroyed successfully.
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lazy-loading 'resources' on Instance uuid c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T19:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-961972779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-961972779',id=37,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3WQIozmJvqyfadaheJdwm7XTfCi56jtJxG6zTwGrOBTz3btDIifw97R2IPte8aGHlUWNMn9k/l407bJ7SC+AD3laovrRtX5Cf6qVSBb78G3GSYgX73izXV/zuW4nWrFA==',key_name='tempest-keypair-406939974',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6184534338e74f3d827b9aee3e20c617',ramdisk_id='',reservation_id='r-7gpm000s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-470403389',owner_user_name='tempest-AttachVolumeShelveTestJSON-470403389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a00a0387df984129850f1fb1e29a35ce',uuid=c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converting VIF {"id": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "address": "fa:16:3e:b7:97:8e", "network": {"id": "9e878f15-f1f9-4c10-8434-179e23485596", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1668503167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6184534338e74f3d827b9aee3e20c617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37051a47-6c", "ovs_interfaceid": "37051a47-6c49-45f9-a71d-8dd7d07beeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG os_vif [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37051a47-6c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=200a7d48-f90d-4b35-bcd9-a7bd4a69cf75) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: INFO os_vif [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:8e,bridge_name='br-int',has_traffic_filtering=True,id=37051a47-6c49-45f9-a71d-8dd7d07beeeb,network=Network(9e878f15-f1f9-4c10-8434-179e23485596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37051a47-6c')
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Deleting instance files /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff_del
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Deletion of /opt/stack/data/nova/instances/c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff_del complete
Nov 16 19:47:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:18 user nova-compute[86931]: INFO nova.compute.manager [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 16 19:47:18 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:47:18 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:19 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Took 0.92 seconds to deallocate network for instance.
Nov 16 19:47:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-4be20905-483d-44a3-988b-95c87f331997 req-692506d8-3764-4fdb-b73c-be6195530d26 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-deleted-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:47:19 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Deleted allocations for instance c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b3dbc0f0-c0b7-475a-ac5e-30634b6eb59c tempest-AttachVolumeShelveTestJSON-470403389 tempest-AttachVolumeShelveTestJSON-470403389-project-member] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:20 user nova-compute[86931]: WARNING nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state deleted and task_state None.
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:20 user nova-compute[86931]: WARNING nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state deleted and task_state None.
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:20 user nova-compute[86931]: WARNING nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state deleted and task_state None.
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:20 user nova-compute[86931]: WARNING nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-unplugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state deleted and task_state None.
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Acquiring lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] Lock "c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] No waiting events found dispatching network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:47:20 user nova-compute[86931]: WARNING nova.compute.manager [req-ee0b070e-60c7-4aac-9f7d-920fe797f31e req-a03bc67a-9ce3-4397-bcd2-561a6b648b99 service nova] [instance: c6a9bb81-49fa-4f1f-a1ee-9e8c1dcbc3ff] Received unexpected event network-vif-plugged-37051a47-6c49-45f9-a71d-8dd7d07beeeb for instance with vm_state deleted and task_state None.
Nov 16 19:47:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:47:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-changed-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Refreshing instance network info cache due to event network-changed-b73f9a93-75e7-4352-a39c-0c27af9ada60. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] Acquiring lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] Acquired lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Refreshing network info cache for port b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updated VIF entry in instance network info cache for port b73f9a93-75e7-4352-a39c-0c27af9ada60. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:47:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updating instance_info_cache with network_info: [{"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:47:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-542592c3-35b9-426f-a82f-ec6b9720ac47 req-fc8efc10-2a09-48b3-9394-eb63fcdc0cab service nova] Releasing lock "refresh_cache-b618955e-fec4-4b7f-9664-979d864e51ca" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:47:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:56 user nova-compute[86931]: INFO nova.compute.manager [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Attaching volume 74e37723-a8a7-41eb-bdda-9df5b2908443 to /dev/vdb
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ea5cd-9df1-4dca-95bb-40e4ff609e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1650db-bbea-4646-a9f1-9dcb24724779]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fffb44-76c0-4b4f-a4ed-e1894fc32b42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe6462-caa2-48be-828e-d0788b335553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:47:56 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[29452c82-cc4b-4bb0-a34a-183adb46d0e7]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updating existing volume attachment record: 245e51a8-7854-476a-99ca-6ced9b91594e {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:47:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:47:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:48:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:48:01 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=25.08993148803711GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkWlbfSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:48:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:48:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:48:01 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[071eb2c8-c863-47d3-acc1-3b0d63aec270]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:48:01 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f96479e-d32c-4a51-a9e8-7e98b6e95cc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443] added
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb2727-f4a3-45ee-8cf5-066ad069d2c0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d9c470-0c93-45a8-aa1c-093e65084e1e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkWlbfSH {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkWlbfSH" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490eb17-f368-4fb2-b59b-23a701f4ec6d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkWlbfSH'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[08de02bd-3b81-43e4-9ce2-b1d387f484d7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[804bad3f-6cb1-4611-9252-87fdd806d4ac]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0e34a-3d27-464b-be30-c572b829fcf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260]
Nov 16 19:48:01 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260] successful.
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance b618955e-fec4-4b7f-9664-979d864e51ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a577b89-5c1d-4250-bd22-d31f3a4dd865]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53c41b-0392-424b-9332-a2883307eebe]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:01 user nova-compute[86931]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:01 user nova-compute[86931]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)
Nov 16 19:48:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d897c58-b934-418b-9734-fe44d29bbe64]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkWlbfSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:48:01 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23633646338623237', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633646338623237', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:48:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:48:02 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:48:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:48:02 user nova-compute[86931]:   <serial>74e37723-a8a7-41eb-bdda-9df5b2908443</serial>
Nov 16 19:48:02 user nova-compute[86931]: </disk>
Nov 16 19:48:02 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] No VIF found with MAC fa:16:3e:16:d7:45, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1d2a16be-b88d-4813-b609-71f237a73c9a tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.974s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:48:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:04 user nova-compute[86931]: INFO nova.compute.manager [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Detaching volume 74e37723-a8a7-41eb-bdda-9df5b2908443
Nov 16 19:48:04 user nova-compute[86931]: INFO nova.virt.block_device [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Attempting to driver detach volume 74e37723-a8a7-41eb-bdda-9df5b2908443 from mountpoint /dev/vdb
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Attempting to detach device vdb from instance b618955e-fec4-4b7f-9664-979d864e51ca from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:48:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:48:04 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:48:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:48:04 user nova-compute[86931]:   <serial>74e37723-a8a7-41eb-bdda-9df5b2908443</serial>
Nov 16 19:48:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:48:04 user nova-compute[86931]: </disk>
Nov 16 19:48:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:48:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance b618955e-fec4-4b7f-9664-979d864e51ca from the persistent domain config.
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b618955e-fec4-4b7f-9664-979d864e51ca from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:48:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:48:04 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:48:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:48:04 user nova-compute[86931]:   <serial>74e37723-a8a7-41eb-bdda-9df5b2908443</serial>
Nov 16 19:48:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:48:04 user nova-compute[86931]: </disk>
Nov 16 19:48:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:48:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:48:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:48:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:48:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:48:10 user nova-compute[86931]: INFO nova.compute.claims [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Claim successful on node user
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:48:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.policy [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '929b3c5212494c0fa7b3f1abdc6650a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c8ba4c38fb4c5baac62b4d799134d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:48:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Creating image(s)
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "/opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "/opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.part --force-share --output=json" returned: 0 in 0.203s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG nova.virt.images [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] 0144288c-7b29-4b4c-ad49-c02d8dceb707 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.part /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Successfully created port: da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.part /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.converted" returned: 0 in 0.377s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.266s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Successfully updated port: da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing instance network info cache due to event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad,backing_fmt=raw /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad,backing_fmt=raw /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk 1073741824" returned: 0 in 0.053s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.network.neutron [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Cannot resize image /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Ensure instance console log exists: /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance network_info: |[{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.network.neutron [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Start _get_guest_xml network_info=[{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:48:07Z,direct_url=<?>,disk_format='qcow2',id=0144288c-7b29-4b4c-ad49-c02d8dceb707,min_disk=0,min_ram=0,name='tempest-scenario-img--1136567936',owner='63c8ba4c38fb4c5baac62b4d799134d8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:48:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '0144288c-7b29-4b4c-ad49-c02d8dceb707'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:48:12 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:48:12 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:48:07Z,direct_url=<?>,disk_format='qcow2',id=0144288c-7b29-4b4c-ad49-c02d8dceb707,min_disk=0,min_ram=0,name='tempest-scenario-img--1136567936',owner='63c8ba4c38fb4c5baac62b4d799134d8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:48:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:48:12 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1113815973',display_name='tempest-TestMinimumBasicScenario-server-1113815973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1113815973',id=44,image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo/t+SbKJsWhTcwPyxzUn2qQVxSbzdMRRk//MGXt8tW+lwcHBYM5NcBLJ/zIB+Y9vyw/rem5r7K0Lc6gZCBZmQ8ML8E7g1ZqKAPt6aZVwazzWNy2t7THCPHjPQ2mjde4w==',key_name='tempest-TestMinimumBasicScenario-648453703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-s32sd4mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:48:11Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=e5a3a871-a75e-4d16-87c7-e73c6607b3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'pci_devices' on Instance uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:48:13 user nova-compute[86931]:   <uuid>e5a3a871-a75e-4d16-87c7-e73c6607b3e4</uuid>
Nov 16 19:48:13 user nova-compute[86931]:   <name>instance-0000002c</name>
Nov 16 19:48:13 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:48:13 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:48:13 user nova-compute[86931]:   <metadata>
Nov 16 19:48:13 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:48:13 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:name>tempest-TestMinimumBasicScenario-server-1113815973</nova:name>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:48:12</nova:creationTime>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:48:13 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:48:13 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:owner>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:user uuid="929b3c5212494c0fa7b3f1abdc6650a2">tempest-TestMinimumBasicScenario-708135349-project-member</nova:user>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:project uuid="63c8ba4c38fb4c5baac62b4d799134d8">tempest-TestMinimumBasicScenario-708135349</nova:project>
Nov 16 19:48:13 user nova-compute[86931]:       </nova:owner>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:root type="image" uuid="0144288c-7b29-4b4c-ad49-c02d8dceb707"/>
Nov 16 19:48:13 user nova-compute[86931]:       <nova:ports>
Nov 16 19:48:13 user nova-compute[86931]:         <nova:port uuid="da3f1c0c-a6bc-4ee4-8f26-61a645252cc2">
Nov 16 19:48:13 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 19:48:13 user nova-compute[86931]:         </nova:port>
Nov 16 19:48:13 user nova-compute[86931]:       </nova:ports>
Nov 16 19:48:13 user nova-compute[86931]:     </nova:instance>
Nov 16 19:48:13 user nova-compute[86931]:   </metadata>
Nov 16 19:48:13 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:48:13 user nova-compute[86931]:     <system>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="serial">e5a3a871-a75e-4d16-87c7-e73c6607b3e4</entry>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="uuid">e5a3a871-a75e-4d16-87c7-e73c6607b3e4</entry>
Nov 16 19:48:13 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:48:13 user nova-compute[86931]:     </system>
Nov 16 19:48:13 user nova-compute[86931]:   </sysinfo>
Nov 16 19:48:13 user nova-compute[86931]:   <os>
Nov 16 19:48:13 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:48:13 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:48:13 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:48:13 user nova-compute[86931]:   </os>
Nov 16 19:48:13 user nova-compute[86931]:   <features>
Nov 16 19:48:13 user nova-compute[86931]:     <acpi/>
Nov 16 19:48:13 user nova-compute[86931]:     <apic/>
Nov 16 19:48:13 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:48:13 user nova-compute[86931]:   </features>
Nov 16 19:48:13 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:48:13 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:48:13 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:48:13 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:48:13 user nova-compute[86931]:   </clock>
Nov 16 19:48:13 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:48:13 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:48:13 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:48:13 user nova-compute[86931]:   </cpu>
Nov 16 19:48:13 user nova-compute[86931]:   <devices>
Nov 16 19:48:13 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:48:13 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:48:13 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk"/>
Nov 16 19:48:13 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:48:13 user nova-compute[86931]:     </disk>
Nov 16 19:48:13 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:48:13 user nova-compute[86931]:       <mac address="fa:16:3e:d6:c8:8e"/>
Nov 16 19:48:13 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:48:13 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:48:13 user nova-compute[86931]:       <target dev="tapda3f1c0c-a6"/>
Nov 16 19:48:13 user nova-compute[86931]:     </interface>
Nov 16 19:48:13 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:48:13 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/console.log" append="off"/>
Nov 16 19:48:13 user nova-compute[86931]:     </serial>
Nov 16 19:48:13 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:48:13 user nova-compute[86931]:     <video>
Nov 16 19:48:13 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:48:13 user nova-compute[86931]:     </video>
Nov 16 19:48:13 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:48:13 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:48:13 user nova-compute[86931]:     </rng>
Nov 16 19:48:13 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:48:13 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:48:13 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:48:13 user nova-compute[86931]:     </memballoon>
Nov 16 19:48:13 user nova-compute[86931]:   </devices>
Nov 16 19:48:13 user nova-compute[86931]: </domain>
Nov 16 19:48:13 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1113815973',display_name='tempest-TestMinimumBasicScenario-server-1113815973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1113815973',id=44,image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo/t+SbKJsWhTcwPyxzUn2qQVxSbzdMRRk//MGXt8tW+lwcHBYM5NcBLJ/zIB+Y9vyw/rem5r7K0Lc6gZCBZmQ8ML8E7g1ZqKAPt6aZVwazzWNy2t7THCPHjPQ2mjde4w==',key_name='tempest-TestMinimumBasicScenario-648453703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-s32sd4mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:48:11Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=e5a3a871-a75e-4d16-87c7-e73c6607b3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG os_vif [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7110e4fe-5163-5c8f-854b-61222e99ff1b', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda3f1c0c-a6, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda3f1c0c-a6, col_values=(('qos', UUID('e9423aa5-2510-4475-809f-d81ffb727166')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda3f1c0c-a6, col_values=(('external_ids', {'iface-id': 'da3f1c0c-a6bc-4ee4-8f26-61a645252cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c8:8e', 'vm-uuid': 'e5a3a871-a75e-4d16-87c7-e73c6607b3e4'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:13 user nova-compute[86931]: INFO os_vif [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6')
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No VIF found with MAC fa:16:3e:d6:c8:8e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated VIF entry in instance network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG nova.network.neutron [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-26abfb3d-7252-463f-b415-45781c56d9dd req-9aff733a-399f-40c6-a3ad-bf8768a8398f service nova] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:14 user nova-compute[86931]: WARNING nova.compute.manager [req-45bf33a9-d071-4a37-b295-00d77f10170e req-a41779c2-37c8-42f3-979b-672f7337ce5d service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state building and task_state spawning.
Nov 16 19:48:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:15 user nova-compute[86931]: INFO nova.compute.manager [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Unrescuing
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'flavor' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance destroyed successfully.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:48:16 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance spawned successfully.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:48:16 user nova-compute[86931]: INFO nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:48:16 user nova-compute[86931]: INFO nova.compute.manager [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Took 6.47 seconds to build instance.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e9e1254f-f38d-424a-b228-016aecc0f72d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.578s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.783s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:16 user nova-compute[86931]: INFO nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:16 user nova-compute[86931]: WARNING nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state active and task_state None.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:16 user nova-compute[86931]: WARNING nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:16 user nova-compute[86931]: DEBUG nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:16 user nova-compute[86931]: WARNING nova.compute.manager [req-4d9c79cd-46fd-4d5c-94fa-f71815066e87 req-fc8e2d60-3dc1-4d45-94ed-b3ed5d7ae66f service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:19 user nova-compute[86931]: WARNING nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:48:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:19 user nova-compute[86931]: WARNING nova.compute.manager [req-973789d1-f76b-4581-a947-9ed0be79abe2 req-6e815fdf-67db-4df7-a767-f01034b56b01 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state rescued and task_state unrescuing.
Nov 16 19:48:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-7b8b2d06-57aa-499b-9b62-75df23ba6b28 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:48:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b618955e-fec4-4b7f-9664-979d864e51ca is timed out.
Nov 16 19:48:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully detached device vdb from instance b618955e-fec4-4b7f-9664-979d864e51ca from the live domain config.
Nov 16 19:48:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkWlbfSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:48:24 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecbb12-c1b0-45a4-98ca-710307b4c468]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:48:24 user nova-compute[86931]: No targets found.
Nov 16 19:48:24 user nova-compute[86931]: iSNS:
Nov 16 19:48:24 user nova-compute[86931]: No targets found.
Nov 16 19:48:24 user nova-compute[86931]: STATIC:
Nov 16 19:48:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd
Nov 16 19:48:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:48:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:48:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443
Nov 16 19:48:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:48:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:48:24 user nova-compute[86931]: FIRMWARE:
Nov 16 19:48:24 user nova-compute[86931]: No targets found.
Nov 16 19:48:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:48:24 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:48:24 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051c85e-944e-4e27-97ac-048875866fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e643cb-3d42-4c4c-bb78-fdbf9fd3f46c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:24 user nova-compute[86931]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)
Nov 16 19:48:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:24 user nova-compute[86931]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 (non-flash)
Nov 16 19:48:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c559090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77274e5b-c1a9-4d7f-84d8-f42558ba79ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106b9a6-7ef8-45f0-9610-145caa0f856a]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23024f98-cf70-4f54-8b51-b1064908baaa]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0560c1-7f70-4f67-afe6-daebb7c16862]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a3806-b0d1-459e-9173-39659d6e9f75]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc9bac8-6ce4-4afd-bc4f-d703519d3441]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260]
Nov 16 19:48:25 user nova-compute[86931]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443, portal: 172.16.0.220,3260] successful.
Nov 16 19:48:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74e37723-a8a7-41eb-bdda-9df5b2908443 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[392ca96c-02c9-410b-834e-0cd3330b760a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] <== disconnect_volume: return (318ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'flavor' on Instance uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7784f1f-21e9-4013-870d-76207dd1752f tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.878s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.compute.manager [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing instance network info cache due to event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing network info cache for port 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updated VIF entry in instance network info cache for port 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG nova.network.neutron [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3e46c9cd-fa4f-487c-bde7-33484f20726c req-eefa7ac2-299f-4bfa-beff-46862e144626 service nova] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:51 user nova-compute[86931]: INFO nova.compute.manager [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Attaching volume 8cfaf3b3-214c-49c0-b54e-a8f8b9614625 to /dev/vdb
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.utils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ec319b-406c-487e-85a2-358cfe72f9a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4e3a0-6177-451f-b6b1-6fc9b4218f3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610d3ce-fb78-4cc9-b8e1-3aef2fbb59f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f2c48a-31b7-4f8e-a786-414cad12c482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:48:51 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:48:51 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7fee03-ea9e-4720-aef5-980f7737bfda]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG os_brick.utils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:48:51 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating existing volume attachment record: 10d912b8-b528-4def-b7bd-3956f246cf16 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:48:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:54 user nova-compute[86931]: INFO nova.compute.manager [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Terminating instance
Nov 16 19:48:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-unplugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] No waiting events found dispatching network-vif-unplugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:54 user nova-compute[86931]: DEBUG nova.compute.manager [req-92258c8a-3467-4582-9ba0-361b7aff4bc0 req-400ea504-7618-434d-96f8-81ffe5ede661 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-unplugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:48:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Instance destroyed successfully.
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.objects.instance [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lazy-loading 'resources' on Instance uuid b618955e-fec4-4b7f-9664-979d864e51ca {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1509837353',display_name='tempest-AttachVolumeNegativeTest-server-1509837353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1509837353',id=42,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSjEOQTSdQG174Zr6eoO6mHm0AuwbV6/OB+oRkf8KppfsWKEMaAH7eF3k6SGGKiP/yph1jqrHadVCPZTIj9EzkTcnrePlfgLPOZ8obL6mMQnB85lRvpK7BkaXpTJJr8pA==',key_name='tempest-keypair-65602087',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3ee3cb7b348423c81c90a733038d9ff',ramdisk_id='',reservation_id='r-rmefd7ci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-57450610',owner_user_name='tempest-AttachVolumeNegativeTest-57450610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7112607a7774345b8879d0422b8b94c',uuid=b618955e-fec4-4b7f-9664-979d864e51ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converting VIF {"id": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "address": "fa:16:3e:16:d7:45", "network": {"id": "8a33988d-96fa-44b9-af29-cac419580c36", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2045764099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3ee3cb7b348423c81c90a733038d9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73f9a93-75", "ovs_interfaceid": "b73f9a93-75e7-4352-a39c-0c27af9ada60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG os_vif [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73f9a93-75, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af0acfd9-f5c4-4470-a900-2e469a7a986a) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:55 user nova-compute[86931]: INFO os_vif [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:45,bridge_name='br-int',has_traffic_filtering=True,id=b73f9a93-75e7-4352-a39c-0c27af9ada60,network=Network(8a33988d-96fa-44b9-af29-cac419580c36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73f9a93-75')
Nov 16 19:48:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Deleting instance files /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca_del
Nov 16 19:48:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Deletion of /opt/stack/data/nova/instances/b618955e-fec4-4b7f-9664-979d864e51ca_del complete
Nov 16 19:48:55 user nova-compute[86931]: INFO nova.compute.manager [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:48:55 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:48:55 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:48:56 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Took 0.71 seconds to deallocate network for instance.
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-eea821f8-60a0-4a56-8c7c-70fbf4f441fe req-3c096def-f714-4c43-bc28-fb686f92a474 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-deleted-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:56 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Deleted allocations for instance b618955e-fec4-4b7f-9664-979d864e51ca
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-0b2ca75e-db25-4ae9-9fb1-dff79813f7ad tempest-AttachVolumeNegativeTest-57450610 tempest-AttachVolumeNegativeTest-57450610-project-member] Lock "b618955e-fec4-4b7f-9664-979d864e51ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] Acquiring lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] Lock "b618955e-fec4-4b7f-9664-979d864e51ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:48:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] No waiting events found dispatching network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:48:56 user nova-compute[86931]: WARNING nova.compute.manager [req-b6158816-fa6a-49c8-b118-26e83abe1d3f req-a994abb6-1149-451f-a360-e49acb171d32 service nova] [instance: b618955e-fec4-4b7f-9664-979d864e51ca] Received unexpected event network-vif-plugged-b73f9a93-75e7-4352-a39c-0c27af9ada60 for instance with vm_state deleted and task_state None.
Nov 16 19:48:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:48:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrdvNLZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:48:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:48:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:48:59 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d74170b-78c8-4138-b938-9f2b210945ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:48:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.069s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aaa135-9d1b-4ee9-8e5e-adb51ac87240]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625] added
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c772fe9-2638-4f42-bcc3-298c2bac1f4a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8caee-a133-4fcb-8e7d-4e15deded23f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrdvNLZV {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GrdvNLZV" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0d2c1-41be-4c7b-addb-d901ed7b2102]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GrdvNLZV'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d46fb11-a80c-450c-83cb-506d1a3ca19e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[228071eb-a42d-452d-bdda-d2020770f74c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[945cd885-bf09-4f65-a019-b28473179562]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260]
Nov 16 19:48:59 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260] successful.
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[76adfb22-cef7-47b3-8858-cfc549a294d1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf97de9-e7d0-46ab-acd2-b29ab0ee1768]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:59 user nova-compute[86931]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:48:59 user nova-compute[86931]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)
Nov 16 19:48:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be9d11-aed4-495c-82c5-7ec24d951bc1]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:48:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrdvNLZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26437663439396532', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437663439396532', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG nova.objects.instance [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:49:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:49:00 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:49:00 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:49:00 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:49:00 user nova-compute[86931]:   <serial>8cfaf3b3-214c-49c0-b54e-a8f8b9614625</serial>
Nov 16 19:49:00 user nova-compute[86931]: </disk>
Nov 16 19:49:00 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No VIF found with MAC fa:16:3e:d7:a3:f6, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-7d818b77-34af-4471-a203-b4195f62efcf tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.151s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:49:03 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:49:03 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.063758850097656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:49:03 user nova-compute[86931]: INFO nova.compute.manager [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Detaching volume 8cfaf3b3-214c-49c0-b54e-a8f8b9614625
Nov 16 19:49:03 user nova-compute[86931]: INFO nova.virt.block_device [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Attempting to driver detach volume 8cfaf3b3-214c-49c0-b54e-a8f8b9614625 from mountpoint /dev/vdb
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Attempting to detach device vdb from instance 925365ff-8012-467e-a0f4-19b29b36498d from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:49:03 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:49:03 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:49:03 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:49:03 user nova-compute[86931]:   <serial>8cfaf3b3-214c-49c0-b54e-a8f8b9614625</serial>
Nov 16 19:49:03 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:49:03 user nova-compute[86931]: </disk>
Nov 16 19:49:03 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:49:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully detached device vdb from instance 925365ff-8012-467e-a0f4-19b29b36498d from the persistent domain config.
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 925365ff-8012-467e-a0f4-19b29b36498d from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:49:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:49:03 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:49:03 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:49:03 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:49:03 user nova-compute[86931]:   <serial>8cfaf3b3-214c-49c0-b54e-a8f8b9614625</serial>
Nov 16 19:49:03 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:49:03 user nova-compute[86931]: </disk>
Nov 16 19:49:03 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:49:04 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:49:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:49:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:49:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:49:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:49:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [{"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-433ab086-b0a1-44d9-9840-9696ca7cfca2" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:49:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:49:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 925365ff-8012-467e-a0f4-19b29b36498d is timed out.
Nov 16 19:49:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully detached device vdb from instance 925365ff-8012-467e-a0f4-19b29b36498d from the live domain config.
Nov 16 19:49:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GrdvNLZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:49:24 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fc041-68e4-4d04-b157-6da250114dc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:49:24 user nova-compute[86931]: No targets found.
Nov 16 19:49:24 user nova-compute[86931]: iSNS:
Nov 16 19:49:24 user nova-compute[86931]: No targets found.
Nov 16 19:49:24 user nova-compute[86931]: STATIC:
Nov 16 19:49:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd
Nov 16 19:49:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:49:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:49:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625
Nov 16 19:49:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:49:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:49:24 user nova-compute[86931]: FIRMWARE:
Nov 16 19:49:24 user nova-compute[86931]: No targets found.
Nov 16 19:49:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:49:24 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:49:24 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d4b102-2991-417a-9799-b16df3aed8d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61b2c8-550c-4517-a680-859190782882]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:49:24 user nova-compute[86931]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)
Nov 16 19:49:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:49:24 user nova-compute[86931]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 (non-flash)
Nov 16 19:49:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c286a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ead7de-eea8-4347-a35f-03f8bbdb241b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[74609088-87b0-47de-aa3a-7c1dc7664683]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1130235-e687-45df-9cec-f7ff52568065]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de452c6-d2ae-4adc-be08-8122930f8aa7]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eaa0e0-c83e-4677-bcd6-7671e5349850]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e567064-bb37-40a5-a494-427ff9040534]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260]
Nov 16 19:49:24 user nova-compute[86931]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625, portal: 172.16.0.220,3260] successful.
Nov 16 19:49:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cfaf3b3-214c-49c0-b54e-a8f8b9614625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8468c211-5274-4ee5-984c-18ad762f1740]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== disconnect_volume: return (274ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:49:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:49:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:49:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01896515-fa8a-40c8-b30d-1bf3f1e1bd8f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:49:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:49:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:49:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:49:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:49:56 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:49:57 user nova-compute[86931]: INFO nova.compute.manager [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] instance snapshotting
Nov 16 19:49:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Beginning live snapshot process
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json -f qcow2 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9.delta 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:49:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9.delta 1073741824" returned: 0 in 0.053s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:49:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 19:49:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:49:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] COPY block job progress, current cursor: 19595264 final cursor: 75563008 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:49:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:49:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=86931) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 19:49:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 19:49:59 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:49:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9.delta /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9.delta /opt/stack/data/nova/instances/snapshots/tmp_mo9ciwu/312b9945e090483ea1f47d1a911cedb9" returned: 0 in 0.665s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:00 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Snapshot extracted, beginning image upload
Nov 16 19:50:00 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Snapshot image upload complete
Nov 16 19:50:03 user nova-compute[86931]: INFO nova.compute.manager [None req-b8018eae-62e6-4a2a-a06a-ba297d0d3e57 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Took 6.05 seconds to snapshot the instance on the hypervisor.
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:03 user nova-compute[86931]: INFO nova.compute.manager [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Attaching volume c1f894eb-919d-497d-9fba-c91c6c2bd67f to /dev/vdb
Nov 16 19:50:03 user nova-compute[86931]: DEBUG os_brick.utils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc6869-1bde-4fa4-8cac-b08f32b7748b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd707b8-507b-4d96-8a4a-d0115047e9f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110eed7-e6c0-497a-a84a-c48ce65d4a3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa85011-1b4c-42c6-acd7-b9174cafbd66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:50:04 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8487c-d678-4624-ae9d-b4e64d9a0afd]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG os_brick.utils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating existing volume attachment record: e332c605-cb80-4584-9015-25f4ffda2df0 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:50:04 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:04 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=24.997116088867188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance d583241c-7b40-4992-9e0a-c4c190bace16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.075s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:04 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:50:04 user nova-compute[86931]: INFO nova.compute.claims [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Claim successful on node user
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:50:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.policy [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29c96fafdf954320a248fe70ccbecebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466675c1e7a14722b6356d73101daa85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:50:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Creating image(s)
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "/opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "/opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.part --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Successfully created port: 121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.part --force-share --output=json" returned: 0 in 0.194s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG nova.virt.images [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] 918f3238-4d7f-447d-908a-5f258d913b48 was qcow2, converting to raw {{(pid=86931) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG nova.privsep.utils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=86931) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 19:50:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.part /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.converted {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.part /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.converted" returned: 0 in 0.294s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.converted --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing instance network info cache due to event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.909s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f,backing_fmt=raw /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Successfully updated port: 121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-changed-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.compute.manager [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing instance network info cache due to event network-changed-121f9941-8efa-4800-88b8-7238ce81af77. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] Acquiring lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] Acquired lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.network.neutron [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing network info cache for port 121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f,backing_fmt=raw /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk 1073741824" returned: 0 in 0.079s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "c59bd98eaf98a00063e5e69e39f9fe713e67279f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:50:08 user nova-compute[86931]: INFO nova.compute.manager [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Detaching volume a5600178-a3a7-4258-bb35-77da4e186ccd
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Ensure instance console log exists: /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:08 user nova-compute[86931]: INFO nova.virt.block_device [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Attempting to driver detach volume a5600178-a3a7-4258-bb35-77da4e186ccd from mountpoint /dev/vdb
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Attempting to detach device vdb from instance d583241c-7b40-4992-9e0a-c4c190bace16 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:50:08 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:50:08 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:50:08 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:50:08 user nova-compute[86931]:   <serial>a5600178-a3a7-4258-bb35-77da4e186ccd</serial>
Nov 16 19:50:08 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:50:08 user nova-compute[86931]: </disk>
Nov 16 19:50:08 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:50:08 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully detached device vdb from instance d583241c-7b40-4992-9e0a-c4c190bace16 from the persistent domain config.
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d583241c-7b40-4992-9e0a-c4c190bace16 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:50:08 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:50:08 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:50:08 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:50:08 user nova-compute[86931]:   <serial>a5600178-a3a7-4258-bb35-77da4e186ccd</serial>
Nov 16 19:50:08 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:50:08 user nova-compute[86931]: </disk>
Nov 16 19:50:08 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [{"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-740a055e-78a9-4941-88f6-7d3ba9986c36" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updated VIF entry in instance network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-96f277b9-6a51-4697-afb7-5b8bb844b280 req-00588901-f745-43ef-a5ea-d3e302bfea91 service nova] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-093180ba-cf12-43aa-8b40-99107f3b36a1 req-6ba24478-d421-42b7-933a-de506feeb301 service nova] Releasing lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquired lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating instance_info_cache with network_info: [{"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Releasing lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance network_info: |[{"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:50:08 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Start _get_guest_xml network_info=[{"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bd5898af1514dc127c7dca8080360391',container_format='bare',created_at=2023-11-16T19:49:57Z,direct_url=<?>,disk_format='qcow2',id=918f3238-4d7f-447d-908a-5f258d913b48,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1267466617',owner='466675c1e7a14722b6356d73101daa85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:50:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '918f3238-4d7f-447d-908a-5f258d913b48'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:50:09 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:09 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bd5898af1514dc127c7dca8080360391',container_format='bare',created_at=2023-11-16T19:49:57Z,direct_url=<?>,disk_format='qcow2',id=918f3238-4d7f-447d-908a-5f258d913b48,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1267466617',owner='466675c1e7a14722b6356d73101daa85',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T19:50:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441248690',display_name='tempest-TestStampPattern-server-1441248690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441248690',id=45,image_ref='918f3238-4d7f-447d-908a-5f258d913b48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-10sm0066',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='925365ff-8012-467e-a0f4-19b29b36498d',image_min_disk='1',image_min_ram='0',image_owner_id='466675c1e7a14722b6356d73101daa85',image_owner_project_name='tempest-TestStampPattern-2080453112',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2080453112-project-member',image_user_id='29c96fafdf954320a248fe70ccbecebe',network_allocated='True',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:50:05Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=dbd81549-1028-455d-8ab0-d8c46d5cb1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.objects.instance [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'pci_devices' on Instance uuid dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:50:09 user nova-compute[86931]:   <uuid>dbd81549-1028-455d-8ab0-d8c46d5cb1ea</uuid>
Nov 16 19:50:09 user nova-compute[86931]:   <name>instance-0000002d</name>
Nov 16 19:50:09 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:50:09 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:50:09 user nova-compute[86931]:   <metadata>
Nov 16 19:50:09 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:50:09 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:name>tempest-TestStampPattern-server-1441248690</nova:name>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:50:09</nova:creationTime>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:50:09 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:50:09 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:owner>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:user uuid="29c96fafdf954320a248fe70ccbecebe">tempest-TestStampPattern-2080453112-project-member</nova:user>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:project uuid="466675c1e7a14722b6356d73101daa85">tempest-TestStampPattern-2080453112</nova:project>
Nov 16 19:50:09 user nova-compute[86931]:       </nova:owner>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:root type="image" uuid="918f3238-4d7f-447d-908a-5f258d913b48"/>
Nov 16 19:50:09 user nova-compute[86931]:       <nova:ports>
Nov 16 19:50:09 user nova-compute[86931]:         <nova:port uuid="121f9941-8efa-4800-88b8-7238ce81af77">
Nov 16 19:50:09 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 19:50:09 user nova-compute[86931]:         </nova:port>
Nov 16 19:50:09 user nova-compute[86931]:       </nova:ports>
Nov 16 19:50:09 user nova-compute[86931]:     </nova:instance>
Nov 16 19:50:09 user nova-compute[86931]:   </metadata>
Nov 16 19:50:09 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:50:09 user nova-compute[86931]:     <system>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="serial">dbd81549-1028-455d-8ab0-d8c46d5cb1ea</entry>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="uuid">dbd81549-1028-455d-8ab0-d8c46d5cb1ea</entry>
Nov 16 19:50:09 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:50:09 user nova-compute[86931]:     </system>
Nov 16 19:50:09 user nova-compute[86931]:   </sysinfo>
Nov 16 19:50:09 user nova-compute[86931]:   <os>
Nov 16 19:50:09 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:50:09 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:50:09 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:50:09 user nova-compute[86931]:   </os>
Nov 16 19:50:09 user nova-compute[86931]:   <features>
Nov 16 19:50:09 user nova-compute[86931]:     <acpi/>
Nov 16 19:50:09 user nova-compute[86931]:     <apic/>
Nov 16 19:50:09 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:50:09 user nova-compute[86931]:   </features>
Nov 16 19:50:09 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:50:09 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:50:09 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:50:09 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:50:09 user nova-compute[86931]:   </clock>
Nov 16 19:50:09 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:50:09 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:50:09 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:50:09 user nova-compute[86931]:   </cpu>
Nov 16 19:50:09 user nova-compute[86931]:   <devices>
Nov 16 19:50:09 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:50:09 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:50:09 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk"/>
Nov 16 19:50:09 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:50:09 user nova-compute[86931]:     </disk>
Nov 16 19:50:09 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:50:09 user nova-compute[86931]:       <mac address="fa:16:3e:4e:e8:14"/>
Nov 16 19:50:09 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:50:09 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:50:09 user nova-compute[86931]:       <target dev="tap121f9941-8e"/>
Nov 16 19:50:09 user nova-compute[86931]:     </interface>
Nov 16 19:50:09 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:50:09 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/console.log" append="off"/>
Nov 16 19:50:09 user nova-compute[86931]:     </serial>
Nov 16 19:50:09 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:50:09 user nova-compute[86931]:     <video>
Nov 16 19:50:09 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:50:09 user nova-compute[86931]:     </video>
Nov 16 19:50:09 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:50:09 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:50:09 user nova-compute[86931]:     </rng>
Nov 16 19:50:09 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:50:09 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:50:09 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:50:09 user nova-compute[86931]:     </memballoon>
Nov 16 19:50:09 user nova-compute[86931]:   </devices>
Nov 16 19:50:09 user nova-compute[86931]: </domain>
Nov 16 19:50:09 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441248690',display_name='tempest-TestStampPattern-server-1441248690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441248690',id=45,image_ref='918f3238-4d7f-447d-908a-5f258d913b48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-10sm0066',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='925365ff-8012-467e-a0f4-19b29b36498d',image_min_disk='1',image_min_ram='0',image_owner_id='466675c1e7a14722b6356d73101daa85',image_owner_project_name='tempest-TestStampPattern-2080453112',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2080453112-project-member',image_user_id='29c96fafdf954320a248fe70ccbecebe',network_allocated='True',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:50:05Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=dbd81549-1028-455d-8ab0-d8c46d5cb1ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_vif [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1eed58-e352-5d65-bcc0-457650c37a3b', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap121f9941-8e, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap121f9941-8e, col_values=(('qos', UUID('397a53ea-7180-4732-b15b-53d70dcd24f7')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap121f9941-8e, col_values=(('external_ids', {'iface-id': '121f9941-8efa-4800-88b8-7238ce81af77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e8:14', 'vm-uuid': 'dbd81549-1028-455d-8ab0-d8c46d5cb1ea'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:09 user nova-compute[86931]: INFO os_vif [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e')
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No VIF found with MAC fa:16:3e:4e:e8:14, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing instance network info cache due to event network-changed-a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] Acquiring lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] Acquired lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Refreshing network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updated VIF entry in instance network info cache for port a0d90ba0-4f69-49ee-88bf-3833b772bd0e. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [{"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-a8d0d7b8-863a-43cb-b9d3-bfff6a4b623d req-36ec6972-0e62-4d10-b0a1-06b346e69c73 service nova] Releasing lock "refresh_cache-d583241c-7b40-4992-9e0a-c4c190bace16" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPhRufMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:50:09 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:50:09 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:50:09 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0b735-7230-4b9f-b52d-aaf1b9989e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:50:09 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc80fa3-ef51-47fd-80bb-2beee5bd2057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f] added
Nov 16 19:50:09 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.086s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a8658-10af-4720-a736-9d69a3fca21e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade3aff9-2d0f-4f91-a590-d8cd4224da88]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPhRufMO {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPhRufMO" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f90af-dee2-4ec0-bb13-38c55ece9097]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPhRufMO'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cbd221-859d-4905-8572-82afa9a9886f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc963ae-7154-4811-8a68-a63680e21efb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:10 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:10 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb141be-0686-42c1-bb8b-2350a2ef2a97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260]
Nov 16 19:50:10 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260] successful.
Nov 16 19:50:10 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a50804-7f99-404d-b574-71401cd30231]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adfd6a2-56c6-4955-8af2-c4f894055971]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:10 user nova-compute[86931]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:50:10 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:10 user nova-compute[86931]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:50:10 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b133e8-8042-45f8-ab95-393695ee0da9]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPhRufMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] No waiting events found dispatching network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:10 user nova-compute[86931]: WARNING nova.compute.manager [req-956a93c3-612f-4513-ba6f-80aa4c146d55 req-728a5575-51ac-45e5-a223-e6f6069a8fdc service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received unexpected event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 for instance with vm_state building and task_state spawning.
Nov 16 19:50:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26564663663386236', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564663663386236', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:50:11 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:50:11 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:50:11 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:50:11 user nova-compute[86931]:   <serial>c1f894eb-919d-497d-9fba-c91c6c2bd67f</serial>
Nov 16 19:50:11 user nova-compute[86931]: </disk>
Nov 16 19:50:11 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] No VIF found with MAC fa:16:3e:d6:c8:8e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:50:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e62b9337-d9b0-472b-a57f-1fc223fe9f9c tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.999s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:50:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance spawned successfully.
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:12 user nova-compute[86931]: INFO nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:12 user nova-compute[86931]: DEBUG nova.compute.manager [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] No waiting events found dispatching network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:12 user nova-compute[86931]: WARNING nova.compute.manager [req-c4fb9723-fa9f-4e2d-ac8b-2547c156ab59 req-cd04d1d9-fb58-4089-b6e1-bb12260c1a2c service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received unexpected event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 for instance with vm_state building and task_state spawning.
Nov 16 19:50:12 user nova-compute[86931]: INFO nova.compute.manager [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Took 7.89 seconds to build instance.
Nov 16 19:50:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fdf4a17c-064a-4a41-81b3-11e71303f56f tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.998s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing instance network info cache due to event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:14 user nova-compute[86931]: DEBUG nova.network.neutron [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated VIF entry in instance network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:50:15 user nova-compute[86931]: DEBUG nova.network.neutron [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f8accb76-6841-4663-a335-5e3e003d5e45 req-4196f06c-9720-478f-a67e-7d39929e6bcd service nova] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing instance network info cache due to event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:17 user nova-compute[86931]: INFO nova.compute.manager [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Rebooting instance
Nov 16 19:50:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated VIF entry in instance network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.network.neutron [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ca6216a-e768-4404-983a-d50fb4e951ef req-3ae01c37-2fe3-404b-b1f3-cf31a66b9e77 service nova] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:17 user nova-compute[86931]: DEBUG nova.network.neutron [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:50:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:50:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:20 user nova-compute[86931]: WARNING nova.compute.manager [req-9c7c243f-f13b-4122-9664-6c8148f032e0 req-e863bf30-fb80-4ab9-afe8-d8f280311334 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state active and task_state reboot_started.
Nov 16 19:50:21 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance shutdown successfully.
Nov 16 19:50:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:22 user nova-compute[86931]: WARNING nova.compute.manager [req-c054f191-07b9-44c4-add1-66c08a1d9647 req-5c3a3d83-993a-428d-8734-87a83588807f service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state active and task_state reboot_started.
Nov 16 19:50:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:24 user nova-compute[86931]: WARNING nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state active and task_state reboot_started.
Nov 16 19:50:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:24 user nova-compute[86931]: WARNING nova.compute.manager [req-757aa522-15da-4a55-8a52-08757a468286 req-97c30da7-bdad-4f9b-b1cd-d39226f26fe5 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state active and task_state reboot_started.
Nov 16 19:50:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance running successfully.
Nov 16 19:50:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance soft rebooted successfully.
Nov 16 19:50:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:50:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-861d08c1-a73c-4996-853b-566476442f7d tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.362s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:28 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d583241c-7b40-4992-9e0a-c4c190bace16 is timed out.
Nov 16 19:50:28 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully detached device vdb from instance d583241c-7b40-4992-9e0a-c4c190bace16 from the live domain config.
Nov 16 19:50:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuXsqDFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:50:28 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c30663-20d1-4a47-a431-cc66bf2f2c5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:50:28 user nova-compute[86931]: No targets found.
Nov 16 19:50:28 user nova-compute[86931]: iSNS:
Nov 16 19:50:28 user nova-compute[86931]: No targets found.
Nov 16 19:50:28 user nova-compute[86931]: STATIC:
Nov 16 19:50:28 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f
Nov 16 19:50:28 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:50:28 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:50:28 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd
Nov 16 19:50:28 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:50:28 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:50:28 user nova-compute[86931]: FIRMWARE:
Nov 16 19:50:28 user nova-compute[86931]: No targets found.
Nov 16 19:50:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:50:28 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:50:28 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c5b03-24d3-4900-ae68-c2278b427388]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72581d-07ab-46f8-a585-c5caa5b185a5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:28 user nova-compute[86931]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:50:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd (non-flash)
Nov 16 19:50:28 user nova-compute[86931]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:50:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c642200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5d8f6-94e7-4112-abe7-0fd898c5b5be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6556c68-0a7e-4fd7-8499-38fcf36dcc44]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[62256288-97b0-4e25-b400-0744003f1874]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a0bfe-f7a5-4191-98e1-a303b4574110]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3b4de7-97e6-4fdb-b79e-7da25c176052]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b429c-5973-4a34-810b-ad579068f9e2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260]
Nov 16 19:50:28 user nova-compute[86931]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd, portal: 172.16.0.220,3260] successful.
Nov 16 19:50:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5600178-a3a7-4258-bb35-77da4e186ccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d37eb9-9646-4072-91ba-0748c626384a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] <== disconnect_volume: return (306ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:50:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:50:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:29 user nova-compute[86931]: DEBUG nova.objects.instance [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'flavor' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-345e6a39-22f7-451e-a40e-b95affcbeb31 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:50:52 user nova-compute[86931]: INFO nova.compute.claims [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Claim successful on node user
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:50:52 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.policy [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac61132333854d438aa9d788a4060ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec08c56b9146afb20e6e03163987de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:50:52 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Creating image(s)
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "/opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "/opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "/opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.191s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:52 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk 1073741824" returned: 0 in 0.062s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Successfully created port: d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Cannot resize image /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Ensure instance console log exists: /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Successfully updated port: d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquired lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-changed-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Refreshing instance network info cache due to event network-changed-d48bf339-a583-4b8a-8fb7-bd36127a0492. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] Acquiring lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:50:53 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updating instance_info_cache with network_info: [{"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Releasing lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Instance network_info: |[{"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] Acquired lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Refreshing network info cache for port d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Start _get_guest_xml network_info=[{"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:50:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:54 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-166530945',display_name='tempest-VolumesSnapshotTestJSON-instance-166530945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-166530945',id=46,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfhSreJ4r9SxZj70l9isjyeJbp/PRyxGL+UO/9EHtNQkoiXWmwjbzm/W608Si+w0QFnIzWtS3Zuxdqo2x6mEWYLfGRRok4KC4gM0EH3iS5YEvoonnncTK4Rit+Aw78nQA==',key_name='tempest-keypair-609657039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-zuh4mk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=9348dee0-0f02-4d86-a8a6-1ef89136d98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'pci_devices' on Instance uuid 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:50:54 user nova-compute[86931]:   <uuid>9348dee0-0f02-4d86-a8a6-1ef89136d98d</uuid>
Nov 16 19:50:54 user nova-compute[86931]:   <name>instance-0000002e</name>
Nov 16 19:50:54 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:50:54 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:50:54 user nova-compute[86931]:   <metadata>
Nov 16 19:50:54 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:50:54 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-166530945</nova:name>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:50:54</nova:creationTime>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:50:54 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:50:54 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:owner>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:user uuid="ac61132333854d438aa9d788a4060ee4">tempest-VolumesSnapshotTestJSON-1737668710-project-member</nova:user>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:project uuid="a2ec08c56b9146afb20e6e03163987de">tempest-VolumesSnapshotTestJSON-1737668710</nova:project>
Nov 16 19:50:54 user nova-compute[86931]:       </nova:owner>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:50:54 user nova-compute[86931]:       <nova:ports>
Nov 16 19:50:54 user nova-compute[86931]:         <nova:port uuid="d48bf339-a583-4b8a-8fb7-bd36127a0492">
Nov 16 19:50:54 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 19:50:54 user nova-compute[86931]:         </nova:port>
Nov 16 19:50:54 user nova-compute[86931]:       </nova:ports>
Nov 16 19:50:54 user nova-compute[86931]:     </nova:instance>
Nov 16 19:50:54 user nova-compute[86931]:   </metadata>
Nov 16 19:50:54 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:50:54 user nova-compute[86931]:     <system>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="serial">9348dee0-0f02-4d86-a8a6-1ef89136d98d</entry>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="uuid">9348dee0-0f02-4d86-a8a6-1ef89136d98d</entry>
Nov 16 19:50:54 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:50:54 user nova-compute[86931]:     </system>
Nov 16 19:50:54 user nova-compute[86931]:   </sysinfo>
Nov 16 19:50:54 user nova-compute[86931]:   <os>
Nov 16 19:50:54 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:50:54 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:50:54 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:50:54 user nova-compute[86931]:   </os>
Nov 16 19:50:54 user nova-compute[86931]:   <features>
Nov 16 19:50:54 user nova-compute[86931]:     <acpi/>
Nov 16 19:50:54 user nova-compute[86931]:     <apic/>
Nov 16 19:50:54 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:50:54 user nova-compute[86931]:   </features>
Nov 16 19:50:54 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:50:54 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:50:54 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:50:54 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:50:54 user nova-compute[86931]:   </clock>
Nov 16 19:50:54 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:50:54 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:50:54 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:50:54 user nova-compute[86931]:   </cpu>
Nov 16 19:50:54 user nova-compute[86931]:   <devices>
Nov 16 19:50:54 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:50:54 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:50:54 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk"/>
Nov 16 19:50:54 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:50:54 user nova-compute[86931]:     </disk>
Nov 16 19:50:54 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:50:54 user nova-compute[86931]:       <mac address="fa:16:3e:23:96:8f"/>
Nov 16 19:50:54 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:50:54 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:50:54 user nova-compute[86931]:       <target dev="tapd48bf339-a5"/>
Nov 16 19:50:54 user nova-compute[86931]:     </interface>
Nov 16 19:50:54 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:50:54 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/console.log" append="off"/>
Nov 16 19:50:54 user nova-compute[86931]:     </serial>
Nov 16 19:50:54 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:50:54 user nova-compute[86931]:     <video>
Nov 16 19:50:54 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:50:54 user nova-compute[86931]:     </video>
Nov 16 19:50:54 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:50:54 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:50:54 user nova-compute[86931]:     </rng>
Nov 16 19:50:54 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:50:54 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:50:54 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:50:54 user nova-compute[86931]:     </memballoon>
Nov 16 19:50:54 user nova-compute[86931]:   </devices>
Nov 16 19:50:54 user nova-compute[86931]: </domain>
Nov 16 19:50:54 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-166530945',display_name='tempest-VolumesSnapshotTestJSON-instance-166530945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-166530945',id=46,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfhSreJ4r9SxZj70l9isjyeJbp/PRyxGL+UO/9EHtNQkoiXWmwjbzm/W608Si+w0QFnIzWtS3Zuxdqo2x6mEWYLfGRRok4KC4gM0EH3iS5YEvoonnncTK4Rit+Aw78nQA==',key_name='tempest-keypair-609657039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-zuh4mk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=9348dee0-0f02-4d86-a8a6-1ef89136d98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG os_vif [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bbf8883-932d-55e2-bb5e-3367f52d9e1e', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd48bf339-a5, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd48bf339-a5, col_values=(('qos', UUID('fa4d176c-7789-4873-b99a-8f497843abf1')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd48bf339-a5, col_values=(('external_ids', {'iface-id': 'd48bf339-a583-4b8a-8fb7-bd36127a0492', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:96:8f', 'vm-uuid': '9348dee0-0f02-4d86-a8a6-1ef89136d98d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:54 user nova-compute[86931]: INFO os_vif [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5')
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No VIF found with MAC fa:16:3e:23:96:8f, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updated VIF entry in instance network info cache for port d48bf339-a583-4b8a-8fb7-bd36127a0492. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG nova.network.neutron [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updating instance_info_cache with network_info: [{"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-62118a5a-1fcb-41cb-bc81-34d6c1e298e6 req-ec406c32-2979-42ab-b5eb-6a58e59ada30 service nova] Releasing lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] No waiting events found dispatching network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:55 user nova-compute[86931]: WARNING nova.compute.manager [req-f0e5f440-6ea9-4cc9-92bc-dbde8ce5ded9 req-54a05b5d-f583-472a-9b2f-9c029bf638ae service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received unexpected event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 for instance with vm_state building and task_state spawning.
Nov 16 19:50:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] No waiting events found dispatching network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:57 user nova-compute[86931]: WARNING nova.compute.manager [req-51e01728-0765-42db-bd26-52560a756e97 req-5e2f78ca-4041-4080-98c5-1853f4b84123 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received unexpected event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 for instance with vm_state building and task_state spawning.
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:50:57 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Instance spawned successfully.
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:50:57 user nova-compute[86931]: INFO nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 16 19:50:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:50:57 user nova-compute[86931]: INFO nova.compute.manager [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Took 5.90 seconds to build instance.
Nov 16 19:50:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cae7b715-caeb-49ce-a605-85975436e22c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.010s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:58 user nova-compute[86931]: INFO nova.compute.manager [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Terminating instance
Nov 16 19:50:58 user nova-compute[86931]: DEBUG nova.compute.manager [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-3132ee44-5e8d-4fdb-bede-67e413d22396 req-5e34b53d-e6ad-494d-af4e-92a609e3a86c service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-unplugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Instance destroyed successfully.
Nov 16 19:50:58 user nova-compute[86931]: DEBUG nova.objects.instance [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid d583241c-7b40-4992-9e0a-c4c190bace16 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377330977',display_name='tempest-ServerRescueNegativeTestJSON-server-377330977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377330977',id=41,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7NN1l2qf2xJjcg1t0BcGxbpaM8vD8QOkYUurVG3LnhyEyzz/V0KnWj/SkfCqnPCaZOw9thL8mPJEhxJX7eohj4snwi8wMsTlbFlS1bVRp+FSodAPNx2qPpScQvT6rMag==',key_name='tempest-keypair-767497068',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-tqzj16uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=d583241c-7b40-4992-9e0a-c4c190bace16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "address": "fa:16:3e:fe:9d:3d", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0d90ba0-4f", "ovs_interfaceid": "a0d90ba0-4f69-49ee-88bf-3833b772bd0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG os_vif [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0d90ba0-4f, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbc70558-3914-49e4-bc52-d299d5299779) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:50:59 user nova-compute[86931]: INFO os_vif [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:9d:3d,bridge_name='br-int',has_traffic_filtering=True,id=a0d90ba0-4f69-49ee-88bf-3833b772bd0e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0d90ba0-4f')
Nov 16 19:50:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Deleting instance files /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16_del
Nov 16 19:50:59 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Deletion of /opt/stack/data/nova/instances/d583241c-7b40-4992-9e0a-c4c190bace16_del complete
Nov 16 19:50:59 user nova-compute[86931]: INFO nova.compute.manager [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 19:50:59 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:50:59 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Took 0.69 seconds to deallocate network for instance.
Nov 16 19:50:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:50:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:00 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Deleted allocations for instance d583241c-7b40-4992-9e0a-c4c190bace16
Nov 16 19:51:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-62fbaa30-a4e8-4c6d-9e4e-97d3a8c516d4 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "d583241c-7b40-4992-9e0a-c4c190bace16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] Acquiring lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] Lock "d583241c-7b40-4992-9e0a-c4c190bace16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] No waiting events found dispatching network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:51:00 user nova-compute[86931]: WARNING nova.compute.manager [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received unexpected event network-vif-plugged-a0d90ba0-4f69-49ee-88bf-3833b772bd0e for instance with vm_state deleted and task_state None.
Nov 16 19:51:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-98e3f987-3b04-4c99-bc1f-440b506a03be req-b17565ff-3735-4129-826e-335866a2cc87 service nova] [instance: d583241c-7b40-4992-9e0a-c4c190bace16] Received event network-vif-deleted-a0d90ba0-4f69-49ee-88bf-3833b772bd0e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:02 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:04 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:06 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:51:06 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8371MB free_disk=24.915573120117188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:51:06 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:51:07 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:51:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:51:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:51:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:51:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:55 user nova-compute[86931]: INFO nova.compute.manager [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Terminating instance
Nov 16 19:51:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-07dcf5fe-d513-47c8-a712-f5cbc2d52304 req-67ecbdae-ee29-4cf4-97ad-7b4bcf975f0a service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-unplugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Instance destroyed successfully.
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid 740a055e-78a9-4941-88f6-7d3ba9986c36 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1907946945',display_name='tempest-ServerRescueNegativeTestJSON-server-1907946945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1907946945',id=32,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:37:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-0a657pvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:37:50Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=740a055e-78a9-4941-88f6-7d3ba9986c36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "fdd6a513-8eb1-410c-8b10-f10971521a91", "address": "fa:16:3e:87:0e:0f", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdd6a513-8e", "ovs_interfaceid": "fdd6a513-8eb1-410c-8b10-f10971521a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG os_vif [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdd6a513-8e, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4df056f9-c60c-48b2-a2a1-63bdc9546ab9) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:51:56 user nova-compute[86931]: INFO os_vif [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:0e:0f,bridge_name='br-int',has_traffic_filtering=True,id=fdd6a513-8eb1-410c-8b10-f10971521a91,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdd6a513-8e')
Nov 16 19:51:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Deleting instance files /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36_del
Nov 16 19:51:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Deletion of /opt/stack/data/nova/instances/740a055e-78a9-4941-88f6-7d3ba9986c36_del complete
Nov 16 19:51:56 user nova-compute[86931]: INFO nova.compute.manager [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 19:51:56 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:51:56 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:51:57 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Took 0.40 seconds to deallocate network for instance.
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-e4ec7c81-6d4a-460b-acbf-1fa7d6fce798 req-8fc3f354-b72f-4e14-90a3-4158ea75ab8c service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-deleted-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:57 user nova-compute[86931]: INFO nova.compute.manager [req-e4ec7c81-6d4a-460b-acbf-1fa7d6fce798 req-8fc3f354-b72f-4e14-90a3-4158ea75ab8c service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Neutron deleted interface fdd6a513-8eb1-410c-8b10-f10971521a91; detaching it from the instance and deleting it from the info cache
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-e4ec7c81-6d4a-460b-acbf-1fa7d6fce798 req-8fc3f354-b72f-4e14-90a3-4158ea75ab8c service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-e4ec7c81-6d4a-460b-acbf-1fa7d6fce798 req-8fc3f354-b72f-4e14-90a3-4158ea75ab8c service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Detach interface failed, port_id=fdd6a513-8eb1-410c-8b10-f10971521a91, reason: Instance 740a055e-78a9-4941-88f6-7d3ba9986c36 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-changed-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing instance network info cache due to event network-changed-121f9941-8efa-4800-88b8-7238ce81af77. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] Acquiring lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] Acquired lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing network info cache for port 121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:57 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Deleted allocations for instance 740a055e-78a9-4941-88f6-7d3ba9986c36
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-695a8511-7b00-4cbd-b8a7-9e99ec2f5fb9 tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updated VIF entry in instance network info cache for port 121f9941-8efa-4800-88b8-7238ce81af77. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating instance_info_cache with network_info: [{"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7de0ddc2-c207-405f-a98a-35450057a861 req-c3e1b1c3-1dc4-4a42-b432-96517b731c63 service nova] Releasing lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG nova.objects.instance [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:51:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:58 user nova-compute[86931]: INFO nova.compute.manager [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Attaching volume 71c30aa8-f958-4714-bef0-33c517b19ef5 to /dev/vdb
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.utils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df577b-fbf5-4249-b60e-c893d87ff4dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9696fd9d-afb1-47dd-98ed-0616e5ac6032]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f234e68a-d89e-4c45-bc73-a3b77c796264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0fb517-5a4b-44cf-add7-af2ed9aa669c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] Acquiring lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] Lock "740a055e-78a9-4941-88f6-7d3ba9986c36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG nova.compute.manager [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] No waiting events found dispatching network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:51:58 user nova-compute[86931]: WARNING nova.compute.manager [req-5a3a218d-4aac-4711-b0d1-b5b95ba6d793 req-59cc4291-6630-4d4f-9ca4-357e037dba8b service nova] [instance: 740a055e-78a9-4941-88f6-7d3ba9986c36] Received unexpected event network-vif-plugged-fdd6a513-8eb1-410c-8b10-f10971521a91 for instance with vm_state deleted and task_state None.
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:51:58 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:51:58 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2b31b-d21c-40a8-a702-c4b22222167b]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG os_brick.utils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:51:58 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating existing volume attachment record: df004d99-7ffa-4185-a6b1-21598d1503a7 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:51:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjfayZtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:52:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:02 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f2143-e24a-4925-a893-09cfd53fece7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:52:02 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc14ce-e9a5-424c-8a9f-9d9226c33096]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5] added
Nov 16 19:52:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[80186dca-6102-4089-aa62-5169155d3e7e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e74328-5069-4c45-9f0a-8d1b6eb6b4f3]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjfayZtO {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjfayZtO" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475aec5-5f4c-4502-9241-fda1c7af7bb0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CjfayZtO'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[436359b2-2970-40ba-a57a-74a21de659c6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9d81e-cfb9-4e33-a353-6924fa63b1ee]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eddf820-86c0-4876-982f-fcd8ed48752c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260]
Nov 16 19:52:03 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260] successful.
Nov 16 19:52:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af312f-c29b-4e7e-811d-e39d468eabfc]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd6ebb6-a12d-4378-8988-a56eb80fc5fe]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:03 user nova-compute[86931]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)
Nov 16 19:52:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:03 user nova-compute[86931]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)
Nov 16 19:52:03 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7babe843-616f-4ab3-9236-55a0a50327da]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjfayZtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26537623438353333', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537623438353333', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.objects.instance [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:52:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:04 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:52:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:04 user nova-compute[86931]:   <serial>71c30aa8-f958-4714-bef0-33c517b19ef5</serial>
Nov 16 19:52:04 user nova-compute[86931]: </disk>
Nov 16 19:52:04 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] No VIF found with MAC fa:16:3e:4e:e8:14, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:52:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-60c7e203-c2c4-4bf8-b23b-c4ae97321484 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.836s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:05 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:06 user nova-compute[86931]: INFO nova.compute.manager [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Detaching volume 71c30aa8-f958-4714-bef0-33c517b19ef5
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:06 user nova-compute[86931]: INFO nova.virt.block_device [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Attempting to driver detach volume 71c30aa8-f958-4714-bef0-33c517b19ef5 from mountpoint /dev/vdb
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Attempting to detach device vdb from instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:52:06 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:06 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:52:06 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:06 user nova-compute[86931]:   <serial>71c30aa8-f958-4714-bef0-33c517b19ef5</serial>
Nov 16 19:52:06 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:52:06 user nova-compute[86931]: </disk>
Nov 16 19:52:06 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:52:06 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully detached device vdb from instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea from the persistent domain config.
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:52:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:52:06 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:06 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:52:06 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:06 user nova-compute[86931]:   <serial>71c30aa8-f958-4714-bef0-33c517b19ef5</serial>
Nov 16 19:52:06 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:52:06 user nova-compute[86931]: </disk>
Nov 16 19:52:06 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:07 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:52:07 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:52:07 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=24.914714813232422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 433ab086-b0a1-44d9-9840-9696ca7cfca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:52:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing instance network info cache due to event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated VIF entry in instance network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-36b9c8ae-3c2d-4a2c-9491-71f0dee5ea6e req-b8e8b84a-8e52-4a7e-87c0-33599fd1f26a service nova] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing instance network info cache due to event network-changed-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] Acquiring lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] Acquired lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Refreshing network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:10 user nova-compute[86931]: INFO nova.compute.manager [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Detaching volume c1f894eb-919d-497d-9fba-c91c6c2bd67f
Nov 16 19:52:10 user nova-compute[86931]: INFO nova.virt.block_device [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Attempting to driver detach volume c1f894eb-919d-497d-9fba-c91c6c2bd67f from mountpoint /dev/vdb
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Attempting to detach device vdb from instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:52:10 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:10 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:52:10 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:10 user nova-compute[86931]:   <serial>c1f894eb-919d-497d-9fba-c91c6c2bd67f</serial>
Nov 16 19:52:10 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:52:10 user nova-compute[86931]: </disk>
Nov 16 19:52:10 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:52:10 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully detached device vdb from instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 from the persistent domain config.
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:52:10 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:10 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:52:10 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:10 user nova-compute[86931]:   <serial>c1f894eb-919d-497d-9fba-c91c6c2bd67f</serial>
Nov 16 19:52:10 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:52:10 user nova-compute[86931]: </disk>
Nov 16 19:52:10 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updated VIF entry in instance network info cache for port da3f1c0c-a6bc-4ee4-8f26-61a645252cc2. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [{"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bd649a2e-ce82-418d-a74f-75ad51013c6b req-e104bb3a-45b6-4208-b4a6-49e05481c413 service nova] Releasing lock "refresh_cache-e5a3a871-a75e-4d16-87c7-e73c6607b3e4" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:52:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:52:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:52:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea is timed out.
Nov 16 19:52:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully detached device vdb from instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea from the live domain config.
Nov 16 19:52:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjfayZtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:52:27 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6aa1a-a5da-4628-8dd4-2ae718f08bcc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:52:27 user nova-compute[86931]: No targets found.
Nov 16 19:52:27 user nova-compute[86931]: iSNS:
Nov 16 19:52:27 user nova-compute[86931]: No targets found.
Nov 16 19:52:27 user nova-compute[86931]: STATIC:
Nov 16 19:52:27 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f
Nov 16 19:52:27 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:52:27 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:52:27 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5
Nov 16 19:52:27 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:52:27 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:52:27 user nova-compute[86931]: FIRMWARE:
Nov 16 19:52:27 user nova-compute[86931]: No targets found.
Nov 16 19:52:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:52:27 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:52:27 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2189322b-03d8-4940-b591-b2bdc4f83615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e65d92-828a-4f36-96aa-3d91c0325eed]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:27 user nova-compute[86931]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)
Nov 16 19:52:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:27 user nova-compute[86931]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 (non-flash)
Nov 16 19:52:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c464d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c255a7-36bc-41ea-a1c5-97073c23549e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffc820-7569-436b-a1ee-a4cf42ca02d1]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[539058eb-2bc2-4d92-85d8-2813fa6068f0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef2cb9-5cb6-4d5b-a15e-9e40c03b084a]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a4e78c-f9b0-43b3-a983-6eb92f1dc7df]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ac6bc-552f-483c-9243-fe21f95fb35e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260]
Nov 16 19:52:27 user nova-compute[86931]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5, portal: 172.16.0.220,3260] successful.
Nov 16 19:52:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c30aa8-f958-4714-bef0-33c517b19ef5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[67af1ebf-1131-42b5-9eb9-18556763c7b1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] <== disconnect_volume: return (301ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:52:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:52:28 user nova-compute[86931]: DEBUG nova.objects.instance [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'flavor' on Instance uuid dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bd65fbaf-f3c9-4ae2-ba80-e7ffe07b2582 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:30 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 is timed out.
Nov 16 19:52:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully detached device vdb from instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4 from the live domain config.
Nov 16 19:52:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPhRufMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:52:30 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd191b0-7698-4bab-9577-f91b2c8eb201]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:52:30 user nova-compute[86931]: No targets found.
Nov 16 19:52:30 user nova-compute[86931]: iSNS:
Nov 16 19:52:30 user nova-compute[86931]: No targets found.
Nov 16 19:52:30 user nova-compute[86931]: STATIC:
Nov 16 19:52:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f
Nov 16 19:52:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:52:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:52:30 user nova-compute[86931]: FIRMWARE:
Nov 16 19:52:30 user nova-compute[86931]: No targets found.
Nov 16 19:52:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:52:30 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:52:30 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191db60-3623-4b97-bf70-72a9f7413521]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[add11758-0cbe-4afd-983a-bf074e8d21db]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f (non-flash)
Nov 16 19:52:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c601870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9da230-734d-444a-b36e-13a80aa109a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab26fe-6d95-4f0a-bdf9-837d9b6233d8]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77a6cc-3bfb-4ab5-ae06-2a84b5c98ee4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a639a4dd-93f9-46d7-b74b-f83ed8949811]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdbf993-ed90-488c-a359-6af80b030806]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8e5a8-bada-4277-a4fc-15bfd0118e93]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260]
Nov 16 19:52:30 user nova-compute[86931]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f, portal: 172.16.0.220,3260] successful.
Nov 16 19:52:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f894eb-919d-497d-9fba-c91c6c2bd67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc092e70-3c31-4f22-acfd-fda7c5e1432b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] <== disconnect_volume: return (343ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:52:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:52:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:52:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'flavor' on Instance uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c985b194-d0a4-45f4-9795-82dc94ac1c65 tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-changed-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Refreshing instance network info cache due to event network-changed-d48bf339-a583-4b8a-8fb7-bd36127a0492. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:52:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] Acquiring lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:52:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] Acquired lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:52:42 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Refreshing network info cache for port d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:43 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Ignoring supplied device name: /dev/vdb
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updated VIF entry in instance network info cache for port d48bf339-a583-4b8a-8fb7-bd36127a0492. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG nova.network.neutron [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updating instance_info_cache with network_info: [{"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1d346123-2a70-4da1-a67c-4995d6ba8dcd req-9eda7739-12dc-42a2-a4f7-a4b4b905e130 service nova] Releasing lock "refresh_cache-9348dee0-0f02-4d86-a8a6-1ef89136d98d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:43 user nova-compute[86931]: INFO nova.compute.manager [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Attaching volume 9599ad61-a2f6-4740-9012-71c8ec0896fe to /dev/vdb
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff333ce-074e-4d28-9aff-f2982fe3152c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fed6e3-bef3-4ac1-acdc-a9ae22036387]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2441e21e-1c32-4237-a109-8ff3320dfdcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0905195-b73e-4c5a-9118-7fd595d8fe0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:52:43 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:52:43 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7cb93-43e9-43fb-9ef0-d95feb172c8e]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG os_brick.utils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:52:43 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updating existing volume attachment record: 2bd4e430-bcd7-466b-af6b-845d7c04102d {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:46 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:46 user nova-compute[86931]: INFO nova.compute.manager [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Terminating instance
Nov 16 19:52:46 user nova-compute[86931]: DEBUG nova.compute.manager [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-70deff5c-9ac9-4951-8076-30c4de2c8147 req-8353ba14-5cc6-4924-8d89-9509e275fa14 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-unplugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Instance destroyed successfully.
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.objects.instance [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lazy-loading 'resources' on Instance uuid 433ab086-b0a1-44d9-9840-9696ca7cfca2 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941676357',display_name='tempest-ServerRescueNegativeTestJSON-server-1941676357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941676357',id=31,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:40:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c44cf782aee484eb908f5e0d1a348f9',ramdisk_id='',reservation_id='r-z84ou6tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-714133090',owner_user_name='tempest-ServerRescueNegativeTestJSON-714133090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:42:35Z,user_data=None,user_id='51a6c7bcc5a54d819a6cfa7187229c06',uuid=433ab086-b0a1-44d9-9840-9696ca7cfca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converting VIF {"id": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "address": "fa:16:3e:e5:41:11", "network": {"id": "71be0d72-6338-4e64-a8b4-0a4ba3a28860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2083989671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c44cf782aee484eb908f5e0d1a348f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d417b2f-c2", "ovs_interfaceid": "5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG os_vif [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d417b2f-c2, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e1d98ea-50e0-4b59-97ed-158dcb219508) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:52:47 user nova-compute[86931]: INFO os_vif [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:41:11,bridge_name='br-int',has_traffic_filtering=True,id=5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e,network=Network(71be0d72-6338-4e64-a8b4-0a4ba3a28860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d417b2f-c2')
Nov 16 19:52:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Deleting instance files /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2_del
Nov 16 19:52:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Deletion of /opt/stack/data/nova/instances/433ab086-b0a1-44d9-9840-9696ca7cfca2_del complete
Nov 16 19:52:47 user nova-compute[86931]: INFO nova.compute.manager [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:52:47 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:52:47 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtGnWJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:52:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:52:48 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bee9117-c021-4d3b-b77e-1049fc7e6a7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:52:48 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d836d354-92dd-4278-a196-98d5522b964f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe] added
Nov 16 19:52:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b74d27-fb1d-42fc-bc63-cbeae5e5941e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ed618-64d9-4587-8b1b-afb3d588b958]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtGnWJiX {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtGnWJiX" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e76e9-e1ae-4401-8ed5-cccd49516726]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtGnWJiX'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989a25f-8fb4-4b81-aad9-97d226911eb4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[35747916-2da7-4ca9-a0b4-5f28284b9c7c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:52:48 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:52:48 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 19:52:48 user nova-compute[86931]: 
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb10e807-1f93-4b76-a2f4-ef163f644876]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260]
Nov 16 19:52:48 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260] successful.
Nov 16 19:52:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Took 0.44 seconds to deallocate network for instance.
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4c08f-a43d-483f-b849-cd1aa1d7b42c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b17967-92dd-4644-b110-7c2fab6885b5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)
Nov 16 19:52:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)
Nov 16 19:52:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e8a63f-7544-4ffe-9346-18186d176d72]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtGnWJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:48 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Deleted allocations for instance 433ab086-b0a1-44d9-9840-9696ca7cfca2
Nov 16 19:52:48 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-4730a62b-eda4-4bb5-8b6f-dd862271885f tempest-ServerRescueNegativeTestJSON-714133090 tempest-ServerRescueNegativeTestJSON-714133090-project-member] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] Acquiring lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] Lock "433ab086-b0a1-44d9-9840-9696ca7cfca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] No waiting events found dispatching network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:52:49 user nova-compute[86931]: WARNING nova.compute.manager [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received unexpected event network-vif-plugged-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e for instance with vm_state deleted and task_state None.
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.compute.manager [req-34a9dfb3-13bc-4fa0-9645-6eda4fc4587a req-a6e5d3de-c325-4321-b6de-80ecc7956063 service nova] [instance: 433ab086-b0a1-44d9-9840-9696ca7cfca2] Received event network-vif-deleted-5d417b2f-c2a2-4d4f-96d1-1a9c19cb2b7e {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23864393165383362', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864393165383362', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.objects.instance [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:52:49 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:52:49 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:52:49 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:52:49 user nova-compute[86931]:   <serial>9599ad61-a2f6-4740-9012-71c8ec0896fe</serial>
Nov 16 19:52:49 user nova-compute[86931]: </disk>
Nov 16 19:52:49 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No VIF found with MAC fa:16:3e:23:96:8f, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:52:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-12b86131-e081-4482-bc23-e50548cc3fec tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.597s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-changed-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing instance network info cache due to event network-changed-121f9941-8efa-4800-88b8-7238ce81af77. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] Acquiring lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] Acquired lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.network.neutron [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Refreshing network info cache for port 121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:57 user nova-compute[86931]: INFO nova.compute.manager [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Terminating instance
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-unplugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] No waiting events found dispatching network-vif-unplugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:52:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-d374b3c5-c27b-4edb-bc3d-98ccd8abe70e req-e12a6baa-1ac6-4369-ac07-2a0f2df05b55 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-unplugged-121f9941-8efa-4800-88b8-7238ce81af77 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Instance destroyed successfully.
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.objects.instance [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'resources' on Instance uuid dbd81549-1028-455d-8ab0-d8c46d5cb1ea {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441248690',display_name='tempest-TestStampPattern-server-1441248690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441248690',id=45,image_ref='918f3238-4d7f-447d-908a-5f258d913b48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-10sm0066',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='925365ff-8012-467e-a0f4-19b29b36498d',image_min_disk='1',image_min_ram='0',image_owner_id='466675c1e7a14722b6356d73101daa85',image_owner_project_name='tempest-TestStampPattern-2080453112',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2080453112-project-member',image_user_id='29c96fafdf954320a248fe70ccbecebe',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:50:13Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=dbd81549-1028-455d-8ab0-d8c46d5cb1ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG os_vif [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap121f9941-8e, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=397a53ea-7180-4732-b15b-53d70dcd24f7) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:52:58 user nova-compute[86931]: INFO os_vif [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=121f9941-8efa-4800-88b8-7238ce81af77,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121f9941-8e')
Nov 16 19:52:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Deleting instance files /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea_del
Nov 16 19:52:58 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Deletion of /opt/stack/data/nova/instances/dbd81549-1028-455d-8ab0-d8c46d5cb1ea_del complete
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updated VIF entry in instance network info cache for port 121f9941-8efa-4800-88b8-7238ce81af77. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.neutron [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating instance_info_cache with network_info: [{"id": "121f9941-8efa-4800-88b8-7238ce81af77", "address": "fa:16:3e:4e:e8:14", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121f9941-8e", "ovs_interfaceid": "121f9941-8efa-4800-88b8-7238ce81af77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-39959ab4-c774-4721-8176-f62828d392ca req-2c3fb04c-4685-4626-8318-8f5ffb835139 service nova] Releasing lock "refresh_cache-dbd81549-1028-455d-8ab0-d8c46d5cb1ea" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:52:58 user nova-compute[86931]: INFO nova.compute.manager [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 19:52:58 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:52:58 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Took 0.40 seconds to deallocate network for instance.
Nov 16 19:52:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:52:58 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:52:59 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:52:59 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:52:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:59 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Deleted allocations for instance dbd81549-1028-455d-8ab0-d8c46d5cb1ea
Nov 16 19:52:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-b72b654a-e05f-4b52-a29e-3d99a9bf330d tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:52:59 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] Acquiring lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] Lock "dbd81549-1028-455d-8ab0-d8c46d5cb1ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] No waiting events found dispatching network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:00 user nova-compute[86931]: WARNING nova.compute.manager [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received unexpected event network-vif-plugged-121f9941-8efa-4800-88b8-7238ce81af77 for instance with vm_state deleted and task_state None.
Nov 16 19:53:00 user nova-compute[86931]: DEBUG nova.compute.manager [req-9ae8a63b-9940-407b-9e25-c19f32bfe79c req-633e5440-7d47-47b4-b6ac-0e81995a2060 service nova] [instance: dbd81549-1028-455d-8ab0-d8c46d5cb1ea] Received event network-vif-deleted-121f9941-8efa-4800-88b8-7238ce81af77 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:02 user nova-compute[86931]: INFO nova.compute.manager [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Terminating instance
Nov 16 19:53:02 user nova-compute[86931]: DEBUG nova.compute.manager [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.compute.manager [req-94c609fd-d244-4fc9-aa9b-87620a0fcc30 req-14cbf6ed-0a0f-4835-8989-6f3b8d3e1fae service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-unplugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Instance destroyed successfully.
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lazy-loading 'resources' on Instance uuid e5a3a871-a75e-4d16-87c7-e73c6607b3e4 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1113815973',display_name='tempest-TestMinimumBasicScenario-server-1113815973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1113815973',id=44,image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo/t+SbKJsWhTcwPyxzUn2qQVxSbzdMRRk//MGXt8tW+lwcHBYM5NcBLJ/zIB+Y9vyw/rem5r7K0Lc6gZCBZmQ8ML8E7g1ZqKAPt6aZVwazzWNy2t7THCPHjPQ2mjde4w==',key_name='tempest-TestMinimumBasicScenario-648453703',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:48:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63c8ba4c38fb4c5baac62b4d799134d8',ramdisk_id='',reservation_id='r-s32sd4mm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0144288c-7b29-4b4c-ad49-c02d8dceb707',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-708135349',owner_user_name='tempest-TestMinimumBasicScenario-708135349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:50:25Z,user_data=None,user_id='929b3c5212494c0fa7b3f1abdc6650a2',uuid=e5a3a871-a75e-4d16-87c7-e73c6607b3e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converting VIF {"id": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "address": "fa:16:3e:d6:c8:8e", "network": {"id": "65ae31fd-8a6a-4762-9694-b50ea72e6e9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1017206751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c8ba4c38fb4c5baac62b4d799134d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3f1c0c-a6", "ovs_interfaceid": "da3f1c0c-a6bc-4ee4-8f26-61a645252cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG os_vif [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda3f1c0c-a6, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9423aa5-2510-4475-809f-d81ffb727166) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:03 user nova-compute[86931]: INFO os_vif [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c8:8e,bridge_name='br-int',has_traffic_filtering=True,id=da3f1c0c-a6bc-4ee4-8f26-61a645252cc2,network=Network(65ae31fd-8a6a-4762-9694-b50ea72e6e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3f1c0c-a6')
Nov 16 19:53:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Deleting instance files /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4_del
Nov 16 19:53:03 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Deletion of /opt/stack/data/nova/instances/e5a3a871-a75e-4d16-87c7-e73c6607b3e4_del complete
Nov 16 19:53:03 user nova-compute[86931]: INFO nova.compute.manager [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:03 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Took 0.37 seconds to deallocate network for instance.
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:04 user nova-compute[86931]: INFO nova.compute.manager [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Detaching volume 9599ad61-a2f6-4740-9012-71c8ec0896fe
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:53:04 user nova-compute[86931]: INFO nova.virt.block_device [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Attempting to driver detach volume 9599ad61-a2f6-4740-9012-71c8ec0896fe from mountpoint /dev/vdb
Nov 16 19:53:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Attempting to detach device vdb from instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:53:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:53:04 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:53:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:53:04 user nova-compute[86931]:   <serial>9599ad61-a2f6-4740-9012-71c8ec0896fe</serial>
Nov 16 19:53:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:53:04 user nova-compute[86931]: </disk>
Nov 16 19:53:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:53:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully detached device vdb from instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d from the persistent domain config.
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:53:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:53:04 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:53:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:53:04 user nova-compute[86931]:   <serial>9599ad61-a2f6-4740-9012-71c8ec0896fe</serial>
Nov 16 19:53:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:53:04 user nova-compute[86931]: </disk>
Nov 16 19:53:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:53:04 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Deleted allocations for instance e5a3a871-a75e-4d16-87c7-e73c6607b3e4
Nov 16 19:53:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c433633a-458f-4b6b-974f-18fa5f4ebd7b tempest-TestMinimumBasicScenario-708135349 tempest-TestMinimumBasicScenario-708135349-project-member] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] Acquiring lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] Lock "e5a3a871-a75e-4d16-87c7-e73c6607b3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] No waiting events found dispatching network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:05 user nova-compute[86931]: WARNING nova.compute.manager [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received unexpected event network-vif-plugged-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 for instance with vm_state deleted and task_state None.
Nov 16 19:53:05 user nova-compute[86931]: DEBUG nova.compute.manager [req-c007ffb6-63c3-4059-bf8f-cde3e4de2c6f req-c97bd7cd-cf6e-4529-ae29-1de6a1e83a29 service nova] [instance: e5a3a871-a75e-4d16-87c7-e73c6607b3e4] Received event network-vif-deleted-da3f1c0c-a6bc-4ee4-8f26-61a645252cc2 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Skipping network cache update for instance because it is being deleted. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:53:06 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:07 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:08 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:53:08 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:53:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.962425231933594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 925365ff-8012-467e-a0f4-19b29b36498d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:53:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:53:09 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:53:09 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:53:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:53:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:53:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:53:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:53:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:53:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:53:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d is timed out.
Nov 16 19:53:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully detached device vdb from instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d from the live domain config.
Nov 16 19:53:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtGnWJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:53:24 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b561b-48ec-41b9-8d5a-7d06c592363c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:53:24 user nova-compute[86931]: No targets found.
Nov 16 19:53:24 user nova-compute[86931]: iSNS:
Nov 16 19:53:24 user nova-compute[86931]: No targets found.
Nov 16 19:53:24 user nova-compute[86931]: STATIC:
Nov 16 19:53:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe
Nov 16 19:53:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:53:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:53:24 user nova-compute[86931]: FIRMWARE:
Nov 16 19:53:24 user nova-compute[86931]: No targets found.
Nov 16 19:53:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:53:24 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:53:24 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[03530d86-eb44-427d-a09f-9feaa69e8aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[374003cd-87f2-4802-8a20-cfd988ade3fe]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)
Nov 16 19:53:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe (non-flash)
Nov 16 19:53:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c404a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed77dc-5e11-4bf3-be75-5504c8d970bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5494219-59cb-4bc8-96ac-73c8ddfc90c3]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[43049739-487c-4bc6-9cd9-8bd326f35d9c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c879c-9a0e-4bbc-8b1b-3931cd3630f4]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4611127-2bd4-4e3b-9303-9eb172c0d343]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[311c57f2-68df-4101-aa13-e9c923b61468]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260]
Nov 16 19:53:25 user nova-compute[86931]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe, portal: 172.16.0.220,3260] successful.
Nov 16 19:53:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a38bc-b014-472e-b6fd-5012fc222c70]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== disconnect_volume: return (302ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-98c53784-44d7-4893-abfc-8115feed067c tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.522s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:25 user nova-compute[86931]: INFO nova.compute.manager [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Terminating instance
Nov 16 19:53:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-unplugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] No waiting events found dispatching network-vif-unplugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.compute.manager [req-34949752-62fe-4434-b777-8b6299097347 req-e3584e33-623d-4726-9405-64d90beb8abf service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-unplugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:53:26 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Instance destroyed successfully.
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.objects.instance [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'resources' on Instance uuid 9348dee0-0f02-4d86-a8a6-1ef89136d98d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-166530945',display_name='tempest-VolumesSnapshotTestJSON-instance-166530945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-166530945',id=46,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfhSreJ4r9SxZj70l9isjyeJbp/PRyxGL+UO/9EHtNQkoiXWmwjbzm/W608Si+w0QFnIzWtS3Zuxdqo2x6mEWYLfGRRok4KC4gM0EH3iS5YEvoonnncTK4Rit+Aw78nQA==',key_name='tempest-keypair-609657039',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-zuh4mk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=9348dee0-0f02-4d86-a8a6-1ef89136d98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "address": "fa:16:3e:23:96:8f", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48bf339-a5", "ovs_interfaceid": "d48bf339-a583-4b8a-8fb7-bd36127a0492", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_vif [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd48bf339-a5, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa4d176c-7789-4873-b99a-8f497843abf1) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:26 user nova-compute[86931]: INFO os_vif [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:96:8f,bridge_name='br-int',has_traffic_filtering=True,id=d48bf339-a583-4b8a-8fb7-bd36127a0492,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48bf339-a5')
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:9599ad61-a2f6-4740-9012-71c8ec0896fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtGnWJiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:53:26 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[4e9cded9-d069-44aa-9a34-488aa9d12e11]: Unexpected error while running command.
Nov 16 19:53:26 user nova-compute[86931]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 19:53:26 user nova-compute[86931]: Exit code: 21
Nov 16 19:53:26 user nova-compute[86931]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 19:53:26 user nova-compute[86931]: Stderr: '' {{(pid=97490) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 16 19:53:26 user nova-compute[86931]: Traceback (most recent call last):
Nov 16 19:53:26 user nova-compute[86931]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 16 19:53:26 user nova-compute[86931]:     ret = func(*f_args, **f_kwargs)
Nov 16 19:53:26 user nova-compute[86931]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 16 19:53:26 user nova-compute[86931]:     return func(*args, **kwargs)
Nov 16 19:53:26 user nova-compute[86931]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 16 19:53:26 user nova-compute[86931]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 16 19:53:26 user nova-compute[86931]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 16 19:53:26 user nova-compute[86931]:     return putils.execute(on_execute=on_execute,
Nov 16 19:53:26 user nova-compute[86931]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 16 19:53:26 user nova-compute[86931]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 16 19:53:26 user nova-compute[86931]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 19:53:26 user nova-compute[86931]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 19:53:26 user nova-compute[86931]: Exit code: 21
Nov 16 19:53:26 user nova-compute[86931]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 19:53:26 user nova-compute[86931]: Stderr: ''
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9cded9-d069-44aa-9a34-488aa9d12e11]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 19:53:26 user nova-compute[86931]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 19:53:26 user nova-compute[86931]: Exit code: 21
Nov 16 19:53:26 user nova-compute[86931]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 19:53:26 user nova-compute[86931]: Stderr: ''
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 16 19:53:26 user nova-compute[86931]: ERROR os_brick.initiator.connectors.iscsi 
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=86931) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== disconnect_volume: return (35ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:53:26 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Deleting instance files /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d_del
Nov 16 19:53:26 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Deletion of /opt/stack/data/nova/instances/9348dee0-0f02-4d86-a8a6-1ef89136d98d_del complete
Nov 16 19:53:26 user nova-compute[86931]: INFO nova.compute.manager [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 19:53:26 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:53:26 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:27 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Took 0.75 seconds to deallocate network for instance.
Nov 16 19:53:27 user nova-compute[86931]: WARNING nova.volume.cinder [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Attachment 2bd4e430-bcd7-466b-af6b-845d7c04102d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2bd4e430-bcd7-466b-af6b-845d7c04102d. (HTTP 404) (Request-ID: req-2f197936-8387-4ab4-9c8f-98b613a4fd61)
Nov 16 19:53:27 user nova-compute[86931]: INFO nova.compute.manager [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Took 0.02 seconds to detach 1 volumes for instance.
Nov 16 19:53:27 user nova-compute[86931]: DEBUG nova.compute.manager [req-b9086041-d09c-4b52-a6dc-0c2be1cde224 req-3f745d01-139d-4eec-b99b-adbb7b5cf35e service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-deleted-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:53:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:27 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Deleted allocations for instance 9348dee0-0f02-4d86-a8a6-1ef89136d98d
Nov 16 19:53:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-41167bfd-8de7-4dff-9ff0-2659d7922ae2 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] Acquiring lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] Lock "9348dee0-0f02-4d86-a8a6-1ef89136d98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] No waiting events found dispatching network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:28 user nova-compute[86931]: WARNING nova.compute.manager [req-d94375a0-20bd-48a0-9fe1-efedcfb57434 req-21a85d18-3d01-4b69-9131-7fdb71c08b85 service nova] [instance: 9348dee0-0f02-4d86-a8a6-1ef89136d98d] Received unexpected event network-vif-plugged-d48bf339-a583-4b8a-8fb7-bd36127a0492 for instance with vm_state deleted and task_state None.
Nov 16 19:53:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.compute.manager [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing instance network info cache due to event network-changed-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] Acquiring lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] Acquired lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.network.neutron [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Refreshing network info cache for port 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:55 user nova-compute[86931]: INFO nova.compute.manager [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Terminating instance
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.network.neutron [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updated VIF entry in instance network info cache for port 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG nova.network.neutron [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [{"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-881980b0-087b-4ff4-bbe3-610ad1f8946c req-f78b35ac-f27b-46d1-9530-71b9689296c1 service nova] Releasing lock "refresh_cache-925365ff-8012-467e-a0f4-19b29b36498d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Instance destroyed successfully.
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.objects.instance [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lazy-loading 'resources' on Instance uuid 925365ff-8012-467e-a0f4-19b29b36498d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-206850242',display_name='tempest-TestStampPattern-server-206850242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-206850242',id=43,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO8IFDymvXc4nimaJQeiroNqwnh38FHul5w7jS4WqzgavvdRiApdZOBH0kQSbMm33mw0uEMmRVzsfVy5/5kmqt/gg5B1VixuyyT2Y0r5GN1x0B4XbQn2TYR9wimn4VvoQ==',key_name='tempest-TestStampPattern-1022346243',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:47:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466675c1e7a14722b6356d73101daa85',ramdisk_id='',reservation_id='r-ug70fvyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2080453112',owner_user_name='tempest-TestStampPattern-2080453112-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:50:03Z,user_data=None,user_id='29c96fafdf954320a248fe70ccbecebe',uuid=925365ff-8012-467e-a0f4-19b29b36498d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converting VIF {"id": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "address": "fa:16:3e:d7:a3:f6", "network": {"id": "81393e07-62a7-4bb9-ac7e-4f88b5f59c33", "bridge": "br-int", "label": "tempest-TestStampPattern-794686694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466675c1e7a14722b6356d73101daa85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a6be0a8-7f", "ovs_interfaceid": "3a6be0a8-7f0d-46ad-b448-72b0a75e85bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG os_vif [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a6be0a8-7f, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4d0c83e-1100-452a-9c0c-6702b5f65761) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:53:56 user nova-compute[86931]: INFO os_vif [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:a3:f6,bridge_name='br-int',has_traffic_filtering=True,id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc,network=Network(81393e07-62a7-4bb9-ac7e-4f88b5f59c33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a6be0a8-7f')
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Deleting instance files /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d_del
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Deletion of /opt/stack/data/nova/instances/925365ff-8012-467e-a0f4-19b29b36498d_del complete
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.compute.manager [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 19:53:56 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Took 0.41 seconds to deallocate network for instance.
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-0948a1cf-f949-4565-b64e-95d19fbb3316 req-16f129da-d1cd-4cad-81e9-539b582f981e service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-vif-deleted-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.compute.manager [req-0948a1cf-f949-4565-b64e-95d19fbb3316 req-16f129da-d1cd-4cad-81e9-539b582f981e service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Neutron deleted interface 3a6be0a8-7f0d-46ad-b448-72b0a75e85bc; detaching it from the instance and deleting it from the info cache
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.network.neutron [req-0948a1cf-f949-4565-b64e-95d19fbb3316 req-16f129da-d1cd-4cad-81e9-539b582f981e service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-0948a1cf-f949-4565-b64e-95d19fbb3316 req-16f129da-d1cd-4cad-81e9-539b582f981e service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Detach interface failed, port_id=3a6be0a8-7f0d-46ad-b448-72b0a75e85bc, reason: Instance 925365ff-8012-467e-a0f4-19b29b36498d could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:53:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:56 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Deleted allocations for instance 925365ff-8012-467e-a0f4-19b29b36498d
Nov 16 19:53:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-49b567a4-7c68-4013-b82e-71b079f22541 tempest-TestStampPattern-2080453112 tempest-TestStampPattern-2080453112-project-member] Lock "925365ff-8012-467e-a0f4-19b29b36498d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.685s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-vif-unplugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] No waiting events found dispatching network-vif-unplugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:57 user nova-compute[86931]: WARNING nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received unexpected event network-vif-unplugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc for instance with vm_state deleted and task_state None.
Nov 16 19:53:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Acquiring lock "925365ff-8012-467e-a0f4-19b29b36498d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] Lock "925365ff-8012-467e-a0f4-19b29b36498d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:53:57 user nova-compute[86931]: DEBUG nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] No waiting events found dispatching network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:53:57 user nova-compute[86931]: WARNING nova.compute.manager [req-2ae38ffb-9deb-4d64-8af7-3b077e40bbeb req-826c2df8-4b6f-429d-9858-47749689caf3 service nova] [instance: 925365ff-8012-467e-a0f4-19b29b36498d] Received unexpected event network-vif-plugged-3a6be0a8-7f0d-46ad-b448-72b0a75e85bc for instance with vm_state deleted and task_state None.
Nov 16 19:53:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:53:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:54:09 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:09 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.151870727539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cdd97c19-f165-4c85-892a-8aaf0146da4d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.055s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:54:09 user nova-compute[86931]: INFO nova.compute.claims [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Claim successful on node user
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:54:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.policy [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac61132333854d438aa9d788a4060ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2ec08c56b9146afb20e6e03163987de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:54:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Creating image(s)
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "/opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "/opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk 1073741824" returned: 0 in 0.047s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Successfully created port: 59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Cannot resize image /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Ensure instance console log exists: /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Successfully updated port: 59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquired lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-changed-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Refreshing instance network info cache due to event network-changed-59baff9d-dba2-4e51-8098-ccbc2b912740. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] Acquiring lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating instance_info_cache with network_info: [{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Releasing lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Instance network_info: |[{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] Acquired lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Refreshing network info cache for port 59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Start _get_guest_xml network_info=[{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:54:11 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:11 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1561177812',display_name='tempest-VolumesSnapshotTestJSON-instance-1561177812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1561177812',id=47,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNXKLrFFfHcaacv2HVXb7oQq4tYr+806k4YveDRPe2+433a6ATcMyzvPtr7OnrN9/f1L1gyoedK+UJ2dFBHrz0n5tgNr9ZYF6EdAL7ez/n9G3kwfyV8jeGBIFsd28fhCQ==',key_name='tempest-keypair-1093182424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-pas9l6w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=cdd97c19-f165-4c85-892a-8aaf0146da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.objects.instance [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'pci_devices' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:54:11 user nova-compute[86931]:   <uuid>cdd97c19-f165-4c85-892a-8aaf0146da4d</uuid>
Nov 16 19:54:11 user nova-compute[86931]:   <name>instance-0000002f</name>
Nov 16 19:54:11 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:54:11 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:54:11 user nova-compute[86931]:   <metadata>
Nov 16 19:54:11 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:54:11 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1561177812</nova:name>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:54:11</nova:creationTime>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:54:11 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:54:11 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:owner>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:user uuid="ac61132333854d438aa9d788a4060ee4">tempest-VolumesSnapshotTestJSON-1737668710-project-member</nova:user>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:project uuid="a2ec08c56b9146afb20e6e03163987de">tempest-VolumesSnapshotTestJSON-1737668710</nova:project>
Nov 16 19:54:11 user nova-compute[86931]:       </nova:owner>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:54:11 user nova-compute[86931]:       <nova:ports>
Nov 16 19:54:11 user nova-compute[86931]:         <nova:port uuid="59baff9d-dba2-4e51-8098-ccbc2b912740">
Nov 16 19:54:11 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 19:54:11 user nova-compute[86931]:         </nova:port>
Nov 16 19:54:11 user nova-compute[86931]:       </nova:ports>
Nov 16 19:54:11 user nova-compute[86931]:     </nova:instance>
Nov 16 19:54:11 user nova-compute[86931]:   </metadata>
Nov 16 19:54:11 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:54:11 user nova-compute[86931]:     <system>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="serial">cdd97c19-f165-4c85-892a-8aaf0146da4d</entry>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="uuid">cdd97c19-f165-4c85-892a-8aaf0146da4d</entry>
Nov 16 19:54:11 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:54:11 user nova-compute[86931]:     </system>
Nov 16 19:54:11 user nova-compute[86931]:   </sysinfo>
Nov 16 19:54:11 user nova-compute[86931]:   <os>
Nov 16 19:54:11 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:54:11 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:54:11 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:54:11 user nova-compute[86931]:   </os>
Nov 16 19:54:11 user nova-compute[86931]:   <features>
Nov 16 19:54:11 user nova-compute[86931]:     <acpi/>
Nov 16 19:54:11 user nova-compute[86931]:     <apic/>
Nov 16 19:54:11 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:54:11 user nova-compute[86931]:   </features>
Nov 16 19:54:11 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:54:11 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:54:11 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:54:11 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:54:11 user nova-compute[86931]:   </clock>
Nov 16 19:54:11 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:54:11 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:54:11 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:54:11 user nova-compute[86931]:   </cpu>
Nov 16 19:54:11 user nova-compute[86931]:   <devices>
Nov 16 19:54:11 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:54:11 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:54:11 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk"/>
Nov 16 19:54:11 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:54:11 user nova-compute[86931]:     </disk>
Nov 16 19:54:11 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:54:11 user nova-compute[86931]:       <mac address="fa:16:3e:10:94:53"/>
Nov 16 19:54:11 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:11 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:54:11 user nova-compute[86931]:       <target dev="tap59baff9d-db"/>
Nov 16 19:54:11 user nova-compute[86931]:     </interface>
Nov 16 19:54:11 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:54:11 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/console.log" append="off"/>
Nov 16 19:54:11 user nova-compute[86931]:     </serial>
Nov 16 19:54:11 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:54:11 user nova-compute[86931]:     <video>
Nov 16 19:54:11 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:11 user nova-compute[86931]:     </video>
Nov 16 19:54:11 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:54:11 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:54:11 user nova-compute[86931]:     </rng>
Nov 16 19:54:11 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:54:11 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:54:11 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:54:11 user nova-compute[86931]:     </memballoon>
Nov 16 19:54:11 user nova-compute[86931]:   </devices>
Nov 16 19:54:11 user nova-compute[86931]: </domain>
Nov 16 19:54:11 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1561177812',display_name='tempest-VolumesSnapshotTestJSON-instance-1561177812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1561177812',id=47,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNXKLrFFfHcaacv2HVXb7oQq4tYr+806k4YveDRPe2+433a6ATcMyzvPtr7OnrN9/f1L1gyoedK+UJ2dFBHrz0n5tgNr9ZYF6EdAL7ez/n9G3kwfyV8jeGBIFsd28fhCQ==',key_name='tempest-keypair-1093182424',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-pas9l6w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=cdd97c19-f165-4c85-892a-8aaf0146da4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG os_vif [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7db4bb1-1cbd-5414-97ab-85a492925e6b', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59baff9d-db, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59baff9d-db, col_values=(('qos', UUID('7b680fe4-ba24-4b37-9afe-88234207a0e7')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59baff9d-db, col_values=(('external_ids', {'iface-id': '59baff9d-dba2-4e51-8098-ccbc2b912740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:94:53', 'vm-uuid': 'cdd97c19-f165-4c85-892a-8aaf0146da4d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: INFO os_vif [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db')
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No VIF found with MAC fa:16:3e:10:94:53, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updated VIF entry in instance network info cache for port 59baff9d-dba2-4e51-8098-ccbc2b912740. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating instance_info_cache with network_info: [{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0e9752e2-b2a1-466a-9562-292160f3462a req-232a6f23-a91d-4ab8-939f-cce02821f089 service nova] Releasing lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] No waiting events found dispatching network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:13 user nova-compute[86931]: WARNING nova.compute.manager [req-77f6159c-5349-4fdb-96dc-fc0a0534f64d req-d5321a72-0b93-46e4-8ca8-bac4641e18eb service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received unexpected event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 for instance with vm_state building and task_state spawning.
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:54:15 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Instance spawned successfully.
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] No waiting events found dispatching network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:15 user nova-compute[86931]: WARNING nova.compute.manager [req-d5f3cec5-484a-4a25-86e1-42bb678d3293 req-8bf0288c-4ad2-422e-9f2a-4e45ba026dea service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received unexpected event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 for instance with vm_state building and task_state spawning.
Nov 16 19:54:15 user nova-compute[86931]: INFO nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 16 19:54:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:54:15 user nova-compute[86931]: INFO nova.compute.manager [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Took 6.11 seconds to build instance.
Nov 16 19:54:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-48a22758-f3c7-4bca-b9d9-6a3fb9ce8186 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:54:16 user nova-compute[86931]: INFO nova.compute.claims [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Claim successful on node user
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:54:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:54:17 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Creating image(s)
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "/opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "/opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG nova.policy [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eae1da504c7b4d27b56fcffc473b63cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1ca75509e845a2a44c9b32abf93f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk 1073741824" returned: 0 in 0.048s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Cannot resize image /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Ensure instance console log exists: /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Successfully created port: 767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Successfully updated port: 767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquired lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-changed-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Refreshing instance network info cache due to event network-changed-767df5c2-dbc9-4050-9907-e76ae7a60d26. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] Acquiring lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Releasing lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Instance network_info: |[{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] Acquired lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Refreshing network info cache for port 767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Start _get_guest_xml network_info=[{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:54:19 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:19 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1066738290',display_name='tempest-TestServerVolumeAttachmentScenario-server-1066738290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1066738290',id=48,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz7RfJBAyekUafOnWgp5G91H8LC+3166WxSrhYj+hVDXoDNkXkVEeCrnFhRWAi+EY4z6naqs9MD1UaviDdMy9YVj9RoXOKbITdC/1pbGHXUrKH/ChG0IOhHsZr4COQs+g==',key_name='tempest-keypair-90227124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe1ca75509e845a2a44c9b32abf93f49',ramdisk_id='',reservation_id='r-ym2o7bms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1871059517',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1871059517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae1da504c7b4d27b56fcffc473b63cb',uuid=a2ea45ad-28f1-4738-90c7-dd458e82831c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converting VIF {"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.objects.instance [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'pci_devices' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:54:19 user nova-compute[86931]:   <uuid>a2ea45ad-28f1-4738-90c7-dd458e82831c</uuid>
Nov 16 19:54:19 user nova-compute[86931]:   <name>instance-00000030</name>
Nov 16 19:54:19 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:54:19 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:54:19 user nova-compute[86931]:   <metadata>
Nov 16 19:54:19 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:54:19 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1066738290</nova:name>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:54:19</nova:creationTime>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:54:19 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:54:19 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:owner>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:user uuid="eae1da504c7b4d27b56fcffc473b63cb">tempest-TestServerVolumeAttachmentScenario-1871059517-project-member</nova:user>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:project uuid="fe1ca75509e845a2a44c9b32abf93f49">tempest-TestServerVolumeAttachmentScenario-1871059517</nova:project>
Nov 16 19:54:19 user nova-compute[86931]:       </nova:owner>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:54:19 user nova-compute[86931]:       <nova:ports>
Nov 16 19:54:19 user nova-compute[86931]:         <nova:port uuid="767df5c2-dbc9-4050-9907-e76ae7a60d26">
Nov 16 19:54:19 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 19:54:19 user nova-compute[86931]:         </nova:port>
Nov 16 19:54:19 user nova-compute[86931]:       </nova:ports>
Nov 16 19:54:19 user nova-compute[86931]:     </nova:instance>
Nov 16 19:54:19 user nova-compute[86931]:   </metadata>
Nov 16 19:54:19 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:54:19 user nova-compute[86931]:     <system>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="serial">a2ea45ad-28f1-4738-90c7-dd458e82831c</entry>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="uuid">a2ea45ad-28f1-4738-90c7-dd458e82831c</entry>
Nov 16 19:54:19 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:54:19 user nova-compute[86931]:     </system>
Nov 16 19:54:19 user nova-compute[86931]:   </sysinfo>
Nov 16 19:54:19 user nova-compute[86931]:   <os>
Nov 16 19:54:19 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:54:19 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:54:19 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:54:19 user nova-compute[86931]:   </os>
Nov 16 19:54:19 user nova-compute[86931]:   <features>
Nov 16 19:54:19 user nova-compute[86931]:     <acpi/>
Nov 16 19:54:19 user nova-compute[86931]:     <apic/>
Nov 16 19:54:19 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:54:19 user nova-compute[86931]:   </features>
Nov 16 19:54:19 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:54:19 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:54:19 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:54:19 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:54:19 user nova-compute[86931]:   </clock>
Nov 16 19:54:19 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:54:19 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:54:19 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:54:19 user nova-compute[86931]:   </cpu>
Nov 16 19:54:19 user nova-compute[86931]:   <devices>
Nov 16 19:54:19 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:54:19 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:54:19 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk"/>
Nov 16 19:54:19 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:54:19 user nova-compute[86931]:     </disk>
Nov 16 19:54:19 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:54:19 user nova-compute[86931]:       <mac address="fa:16:3e:e8:a8:33"/>
Nov 16 19:54:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:19 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:54:19 user nova-compute[86931]:       <target dev="tap767df5c2-db"/>
Nov 16 19:54:19 user nova-compute[86931]:     </interface>
Nov 16 19:54:19 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:54:19 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/console.log" append="off"/>
Nov 16 19:54:19 user nova-compute[86931]:     </serial>
Nov 16 19:54:19 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:54:19 user nova-compute[86931]:     <video>
Nov 16 19:54:19 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:19 user nova-compute[86931]:     </video>
Nov 16 19:54:19 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:54:19 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:54:19 user nova-compute[86931]:     </rng>
Nov 16 19:54:19 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:54:19 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:54:19 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:54:19 user nova-compute[86931]:     </memballoon>
Nov 16 19:54:19 user nova-compute[86931]:   </devices>
Nov 16 19:54:19 user nova-compute[86931]: </domain>
Nov 16 19:54:19 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1066738290',display_name='tempest-TestServerVolumeAttachmentScenario-server-1066738290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1066738290',id=48,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz7RfJBAyekUafOnWgp5G91H8LC+3166WxSrhYj+hVDXoDNkXkVEeCrnFhRWAi+EY4z6naqs9MD1UaviDdMy9YVj9RoXOKbITdC/1pbGHXUrKH/ChG0IOhHsZr4COQs+g==',key_name='tempest-keypair-90227124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe1ca75509e845a2a44c9b32abf93f49',ramdisk_id='',reservation_id='r-ym2o7bms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1871059517',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1871059517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae1da504c7b4d27b56fcffc473b63cb',uuid=a2ea45ad-28f1-4738-90c7-dd458e82831c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converting VIF {"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG os_vif [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e20f8a0-fc43-591f-8d82-162a9f9f590f', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap767df5c2-db, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap767df5c2-db, col_values=(('qos', UUID('93d3c96f-cfdc-4e8f-b17f-69649a33965b')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap767df5c2-db, col_values=(('external_ids', {'iface-id': '767df5c2-dbc9-4050-9907-e76ae7a60d26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:a8:33', 'vm-uuid': 'a2ea45ad-28f1-4738-90c7-dd458e82831c'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:19 user nova-compute[86931]: INFO os_vif [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db')
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No VIF found with MAC fa:16:3e:e8:a8:33, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updated VIF entry in instance network info cache for port 767df5c2-dbc9-4050-9907-e76ae7a60d26. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG nova.network.neutron [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-9e707716-0c25-4391-bbe0-665e04c360f8 req-d3df3179-d156-4f73-bda9-c9ac9a3dd01f service nova] Releasing lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:21 user nova-compute[86931]: WARNING nova.compute.manager [req-ed1d5db6-5d66-4663-9856-ffba34031530 req-e09b5f2c-04ae-4f0e-aec8-787715bb2a3a service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state building and task_state spawning.
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:54:23 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Instance spawned successfully.
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:23 user nova-compute[86931]: INFO nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:54:23 user nova-compute[86931]: INFO nova.compute.manager [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Took 6.52 seconds to build instance.
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG nova.compute.manager [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:23 user nova-compute[86931]: WARNING nova.compute.manager [req-2f96a19f-be53-41ea-af26-b69b2b9dd955 req-4a1ff247-50b1-420d-bd22-098a40f3175c service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state active and task_state None.
Nov 16 19:54:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-21d611b0-b1ad-44ed-84b5-e82c4154dcab tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.635s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:54:31 user nova-compute[86931]: INFO nova.compute.claims [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Claim successful on node user
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:54:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.policy [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df30371454934336b9480fb2daf319c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f8db82034146c0a37f570bf7e1951e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:54:31 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Creating image(s)
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "/opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "/opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.180s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.183s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk 1073741824" returned: 0 in 0.054s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Successfully created port: 4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Cannot resize image /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Ensure instance console log exists: /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Successfully updated port: 4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquired lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-changed-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Refreshing instance network info cache due to event network-changed-4cec726f-2c97-4f8a-86f0-efad21ac9fb9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] Acquiring lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Updating instance_info_cache with network_info: [{"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Releasing lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Instance network_info: |[{"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] Acquired lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Refreshing network info cache for port 4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Start _get_guest_xml network_info=[{"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:54:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:33 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-45231277',display_name='tempest-VolumesActionsTest-instance-45231277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-45231277',id=49,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-o5n19nuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:32Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=7d1b6a09-fa83-48f9-a8a5-c9ec44336a66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.objects.instance [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:54:33 user nova-compute[86931]:   <uuid>7d1b6a09-fa83-48f9-a8a5-c9ec44336a66</uuid>
Nov 16 19:54:33 user nova-compute[86931]:   <name>instance-00000031</name>
Nov 16 19:54:33 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:54:33 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:54:33 user nova-compute[86931]:   <metadata>
Nov 16 19:54:33 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:54:33 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:name>tempest-VolumesActionsTest-instance-45231277</nova:name>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:54:33</nova:creationTime>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:54:33 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:54:33 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:owner>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:user uuid="df30371454934336b9480fb2daf319c8">tempest-VolumesActionsTest-1471119215-project-member</nova:user>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:project uuid="26f8db82034146c0a37f570bf7e1951e">tempest-VolumesActionsTest-1471119215</nova:project>
Nov 16 19:54:33 user nova-compute[86931]:       </nova:owner>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:54:33 user nova-compute[86931]:       <nova:ports>
Nov 16 19:54:33 user nova-compute[86931]:         <nova:port uuid="4cec726f-2c97-4f8a-86f0-efad21ac9fb9">
Nov 16 19:54:33 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 19:54:33 user nova-compute[86931]:         </nova:port>
Nov 16 19:54:33 user nova-compute[86931]:       </nova:ports>
Nov 16 19:54:33 user nova-compute[86931]:     </nova:instance>
Nov 16 19:54:33 user nova-compute[86931]:   </metadata>
Nov 16 19:54:33 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:54:33 user nova-compute[86931]:     <system>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="serial">7d1b6a09-fa83-48f9-a8a5-c9ec44336a66</entry>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="uuid">7d1b6a09-fa83-48f9-a8a5-c9ec44336a66</entry>
Nov 16 19:54:33 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:54:33 user nova-compute[86931]:     </system>
Nov 16 19:54:33 user nova-compute[86931]:   </sysinfo>
Nov 16 19:54:33 user nova-compute[86931]:   <os>
Nov 16 19:54:33 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:54:33 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:54:33 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:54:33 user nova-compute[86931]:   </os>
Nov 16 19:54:33 user nova-compute[86931]:   <features>
Nov 16 19:54:33 user nova-compute[86931]:     <acpi/>
Nov 16 19:54:33 user nova-compute[86931]:     <apic/>
Nov 16 19:54:33 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:54:33 user nova-compute[86931]:   </features>
Nov 16 19:54:33 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:54:33 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:54:33 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:54:33 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:54:33 user nova-compute[86931]:   </clock>
Nov 16 19:54:33 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:54:33 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:54:33 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:54:33 user nova-compute[86931]:   </cpu>
Nov 16 19:54:33 user nova-compute[86931]:   <devices>
Nov 16 19:54:33 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:54:33 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:54:33 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk"/>
Nov 16 19:54:33 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:54:33 user nova-compute[86931]:     </disk>
Nov 16 19:54:33 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:54:33 user nova-compute[86931]:       <mac address="fa:16:3e:11:1d:6e"/>
Nov 16 19:54:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:33 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:54:33 user nova-compute[86931]:       <target dev="tap4cec726f-2c"/>
Nov 16 19:54:33 user nova-compute[86931]:     </interface>
Nov 16 19:54:33 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:54:33 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/console.log" append="off"/>
Nov 16 19:54:33 user nova-compute[86931]:     </serial>
Nov 16 19:54:33 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:54:33 user nova-compute[86931]:     <video>
Nov 16 19:54:33 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:54:33 user nova-compute[86931]:     </video>
Nov 16 19:54:33 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:54:33 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:54:33 user nova-compute[86931]:     </rng>
Nov 16 19:54:33 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:54:33 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:54:33 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:54:33 user nova-compute[86931]:     </memballoon>
Nov 16 19:54:33 user nova-compute[86931]:   </devices>
Nov 16 19:54:33 user nova-compute[86931]: </domain>
Nov 16 19:54:33 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-45231277',display_name='tempest-VolumesActionsTest-instance-45231277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-45231277',id=49,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-o5n19nuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:54:32Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=7d1b6a09-fa83-48f9-a8a5-c9ec44336a66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG os_vif [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e274b0d-7f84-52bb-9d3d-47507d5e3c0e', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cec726f-2c, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cec726f-2c, col_values=(('qos', UUID('aacad8c0-7084-4203-85ef-2e1f7ec02acc')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cec726f-2c, col_values=(('external_ids', {'iface-id': '4cec726f-2c97-4f8a-86f0-efad21ac9fb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:1d:6e', 'vm-uuid': '7d1b6a09-fa83-48f9-a8a5-c9ec44336a66'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:33 user nova-compute[86931]: INFO os_vif [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c')
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] No VIF found with MAC fa:16:3e:11:1d:6e, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Updated VIF entry in instance network info cache for port 4cec726f-2c97-4f8a-86f0-efad21ac9fb9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG nova.network.neutron [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Updating instance_info_cache with network_info: [{"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:54:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-187cb55e-83b4-47bf-b356-5313370c753e req-b0140990-da44-4d3c-928c-7534aa141a9d service nova] Releasing lock "refresh_cache-7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:35 user nova-compute[86931]: WARNING nova.compute.manager [req-c3fe299e-2cdd-4aa8-8c17-6886c6b1001d req-9d0340ee-5ed3-4892-94a4-87b7e0300088 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state building and task_state spawning.
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:54:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Instance spawned successfully.
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:54:37 user nova-compute[86931]: WARNING nova.compute.manager [req-b6e45fd8-4e16-4611-8bca-a79f357e43fb req-5e6e4449-ecc5-4822-8915-892b828c8914 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state building and task_state spawning.
Nov 16 19:54:37 user nova-compute[86931]: INFO nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 16 19:54:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:54:37 user nova-compute[86931]: INFO nova.compute.manager [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Took 6.29 seconds to build instance.
Nov 16 19:54:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-6f7c5406-77c9-406e-94c2-74e8643a362d tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.404s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:54:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:54:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:55:08 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:55:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating instance_info_cache with network_info: [{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:55:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:55:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:55:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:10 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:55:11 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:55:12 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:55:12 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=25.05462646484375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cdd97c19-f165-4c85-892a-8aaf0146da4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a2ea45ad-28f1-4738-90c7-dd458e82831c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:55:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:55:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:55:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:55:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:55:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:55:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-changed-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:55:59 user nova-compute[86931]: DEBUG nova.compute.manager [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Refreshing instance network info cache due to event network-changed-59baff9d-dba2-4e51-8098-ccbc2b912740. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:55:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] Acquiring lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:55:59 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] Acquired lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:55:59 user nova-compute[86931]: DEBUG nova.network.neutron [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Refreshing network info cache for port 59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:56:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updated VIF entry in instance network info cache for port 59baff9d-dba2-4e51-8098-ccbc2b912740. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:56:00 user nova-compute[86931]: DEBUG nova.network.neutron [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating instance_info_cache with network_info: [{"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:56:00 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-f99a9fdd-c52d-4103-b976-c09566dd0abc req-c6d9b989-d35c-4767-bdbf-de7bdf8dffe8 service nova] Releasing lock "refresh_cache-cdd97c19-f165-4c85-892a-8aaf0146da4d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG nova.objects.instance [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:01 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Ignoring supplied device name: /dev/vdb
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:01 user nova-compute[86931]: INFO nova.compute.manager [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Attaching volume 6680d73c-1a38-48c3-a32e-3d58a902032a to /dev/vdb
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.utils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b16bfa-7873-4e4f-a265-3b41ebf6261e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bada35f-386a-4187-80bf-a487b623dcd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47a2eca-01c1-482f-8d44-a8aff281801c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceb8fa8-bd3c-4977-851a-5de2e17ae3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:01 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af0a74-405b-4936-857c-aa46f695a7b0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG os_brick.utils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating existing volume attachment record: 7bc14bdb-4a3a-47e6-9f57-4753641b9d9f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:56:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHiVvTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:06 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:06 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:06 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbcfb08-080c-488f-bdbc-8ebdbfcb85e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:56:06 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6997052-d8b7-48e1-a76b-7554ed16a0cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a] added
Nov 16 19:56:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8f883-e734-4b64-8efe-b43ab862c2cd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a52d5-f0da-43f1-8201-ce0739bb2863]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHiVvTPe {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHiVvTPe" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c00a7-34ed-48e1-ac0c-1ebe5a340f1a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHiVvTPe'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[12215dbe-9efa-4b42-b8e6-30d7b2df0d1a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44faf4c2-e9f6-4cf7-bf38-073259140cf0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:56:06 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 19:56:06 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:06 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 19:56:06 user nova-compute[86931]: 
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e8ef8-a54e-471a-877e-c54f32a23906]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260]
Nov 16 19:56:06 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260] successful.
Nov 16 19:56:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[03611535-b6ff-4546-9a4a-66e49088501b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d695ba8-d1a0-4831-a09c-c35f4e2227ea]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:06 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[68492abb-b4bf-46c8-ad32-781bb9b25761]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:06 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHiVvTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23537663936356165', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537663936356165', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.objects.instance [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:56:07 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:07 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:56:07 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:56:07 user nova-compute[86931]:   <serial>6680d73c-1a38-48c3-a32e-3d58a902032a</serial>
Nov 16 19:56:07 user nova-compute[86931]: </disk>
Nov 16 19:56:07 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] No VIF found with MAC fa:16:3e:10:94:53, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-01649ab1-63b8-447a-9ab9-f2b1c087e336 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.626s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-changed-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Refreshing instance network info cache due to event network-changed-767df5c2-dbc9-4050-9907-e76ae7a60d26. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] Acquiring lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] Acquired lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG nova.network.neutron [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Refreshing network info cache for port 767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:56:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updated VIF entry in instance network info cache for port 767df5c2-dbc9-4050-9907-e76ae7a60d26. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.network.neutron [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d835cdd3-242f-4074-a97e-fc4c6bf20aba req-24d01cfa-b188-4529-a18a-51b750905607 service nova] Releasing lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [{"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-a2ea45ad-28f1-4738-90c7-dd458e82831c" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:09 user nova-compute[86931]: INFO nova.compute.manager [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attaching volume 71b2f754-94d4-432f-ab28-8416b7f14822 to /dev/vdb
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.utils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[724fba50-434e-4544-8d2f-658a34a3afe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cecbfeb-9757-4b76-90c4-5001233d22ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f75fc5-eab0-4744-b4c4-4ec51451a311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9b2e3-8a31-47e4-8a34-23a2d042dbb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:09 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:56:09 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f8653a-f4a0-4dbb-8fd9-777c6011a44d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG os_brick.utils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:09 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating existing volume attachment record: 96381ea5-d30c-4b02-8003-8d3da1263fe8 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:56:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:13 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:56:14 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8686MB free_disk=25.053421020507812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cdd97c19-f165-4c85-892a-8aaf0146da4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a2ea45ad-28f1-4738-90c7-dd458e82831c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOZcXqQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:14 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:14 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:14 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[16998d8f-3685-446b-8151-e1f93135495e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:56:14 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bda0401-a2fd-4dc4-a04b-e873e85b75d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822] added
Nov 16 19:56:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5323298-6483-48d9-8177-e02261d95a30]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.120s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[476987fd-5cd2-4967-887d-533915a8eb80]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOZcXqQA {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOZcXqQA" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29fd0f-1cd2-4d6b-81cc-e62248987951]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jOZcXqQA'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b08132e-671b-48b8-ae07-fdce0cf9e7b8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[77875b6b-249e-4257-acea-fe36455c43b5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:14 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1c760-2d35-4333-a957-1a2bb321f6d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260]
Nov 16 19:56:15 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260] successful.
Nov 16 19:56:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[906262a7-6d53-4ddd-b891-6e4b54e76d0c]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2746c1-de85-4c0c-8219-64317fad8e8f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:15 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:15 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:15 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e208e9a-060e-476e-bb1e-033fc5ff00de]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:15 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOZcXqQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26163616534393632', 'path': '/dev/sdc'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163616534393632', 'path': '/dev/sdc'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:56:16 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:16 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:56:16 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:56:16 user nova-compute[86931]:   <serial>71b2f754-94d4-432f-ab28-8416b7f14822</serial>
Nov 16 19:56:16 user nova-compute[86931]: </disk>
Nov 16 19:56:16 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No VIF found with MAC fa:16:3e:e8:a8:33, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:56:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-5699df24-1e67-44cf-b68e-e445a17968db tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.124s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:19 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:20 user nova-compute[86931]: INFO nova.compute.manager [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attaching volume 36ffc78c-2b38-4956-b556-dfcd85bddf64 to /dev/vdc
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:20 user nova-compute[86931]: INFO nova.compute.manager [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Detaching volume 6680d73c-1a38-48c3-a32e-3d58a902032a
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.utils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e7b38-333f-4179-9647-829478685f5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3b4803-ff9d-45ea-9af2-1bbd36491819]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b50f5d6-3ee5-419f-b160-bc58ddad3f94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c29b2-f86b-42d1-9c58-33d1f925cfb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:20 user nova-compute[86931]: INFO nova.virt.block_device [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Attempting to driver detach volume 6680d73c-1a38-48c3-a32e-3d58a902032a from mountpoint /dev/vdb
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 19:56:20 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[636db820-949c-475a-85c6-2b36a97771f0]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG os_brick.utils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating existing volume attachment record: 8549add3-0f1a-4d87-b4fc-153b866b5597 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Attempting to detach device vdb from instance cdd97c19-f165-4c85-892a-8aaf0146da4d from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:56:20 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:20 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:56:20 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:56:20 user nova-compute[86931]:   <serial>6680d73c-1a38-48c3-a32e-3d58a902032a</serial>
Nov 16 19:56:20 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:56:20 user nova-compute[86931]: </disk>
Nov 16 19:56:20 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:56:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully detached device vdb from instance cdd97c19-f165-4c85-892a-8aaf0146da4d from the persistent domain config.
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdd97c19-f165-4c85-892a-8aaf0146da4d from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:56:20 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:20 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 19:56:20 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:56:20 user nova-compute[86931]:   <serial>6680d73c-1a38-48c3-a32e-3d58a902032a</serial>
Nov 16 19:56:20 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:56:20 user nova-compute[86931]: </disk>
Nov 16 19:56:20 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:56:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:21 user nova-compute[86931]: INFO nova.compute.manager [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Terminating instance
Nov 16 19:56:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:56:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-unplugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-unplugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-e0fae45a-cb5e-4025-b1fb-0db7db1be556 req-c64c5e7d-a625-4143-97e4-cd52e0784ae7 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-unplugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Instance destroyed successfully.
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.objects.instance [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lazy-loading 'resources' on Instance uuid 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-45231277',display_name='tempest-VolumesActionsTest-instance-45231277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-45231277',id=49,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-o5n19nuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:54:38Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=7d1b6a09-fa83-48f9-a8a5-c9ec44336a66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "address": "fa:16:3e:11:1d:6e", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cec726f-2c", "ovs_interfaceid": "4cec726f-2c97-4f8a-86f0-efad21ac9fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG os_vif [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cec726f-2c, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aacad8c0-7084-4203-85ef-2e1f7ec02acc) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:56:22 user nova-compute[86931]: INFO os_vif [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:1d:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cec726f-2c97-4f8a-86f0-efad21ac9fb9,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cec726f-2c')
Nov 16 19:56:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Deleting instance files /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66_del
Nov 16 19:56:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Deletion of /opt/stack/data/nova/instances/7d1b6a09-fa83-48f9-a8a5-c9ec44336a66_del complete
Nov 16 19:56:22 user nova-compute[86931]: INFO nova.compute.manager [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 19:56:22 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:56:22 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:56:23 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Took 0.67 seconds to deallocate network for instance.
Nov 16 19:56:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:56:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:23 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Deleted allocations for instance 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66
Nov 16 19:56:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-2ea36ae5-5beb-4c55-8c28-ceb17765a446 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.692s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:24 user nova-compute[86931]: WARNING nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state deleted and task_state None.
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:24 user nova-compute[86931]: WARNING nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state deleted and task_state None.
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:24 user nova-compute[86931]: WARNING nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state deleted and task_state None.
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Acquiring lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] Lock "7d1b6a09-fa83-48f9-a8a5-c9ec44336a66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] No waiting events found dispatching network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:24 user nova-compute[86931]: WARNING nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received unexpected event network-vif-plugged-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 for instance with vm_state deleted and task_state None.
Nov 16 19:56:24 user nova-compute[86931]: DEBUG nova.compute.manager [req-d2d9c6ed-7586-490b-ae55-22b62547b420 req-5be35724-67e6-442b-b2ca-ba5d3aa87998 service nova] [instance: 7d1b6a09-fa83-48f9-a8a5-c9ec44336a66] Received event network-vif-deleted-4cec726f-2c97-4f8a-86f0-efad21ac9fb9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NofEejRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:25 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:25 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:25 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df1875-faad-4160-8423-5d182e350b2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 19:56:25 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ebd5b-a369-4795-9b3e-0216207b5459]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64] added
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd707b8-1b38-486d-88a8-06c5c8fd7ef2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d0bf1-a083-46e0-9a03-9312cc40d9f2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NofEejRh {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NofEejRh" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061dfd9-2a9f-4db0-8828-ca40bd31c73d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NofEejRh'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab23db-f3b1-4851-9323-8fa4ac387228]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[54222c97-50df-416d-906c-6720ee2663a2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a098d0-9078-40b5-a376-e25957968b59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260]
Nov 16 19:56:25 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260] successful.
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce0f45-4c5e-43c0-86b3-4191ee87e78b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef27b60-b9b2-42e7-bb1a-5a125ec77a31]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83d702c-39b4-4d87-a471-d68ecbe6ded3]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NofEejRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23535613466326366', 'path': '/dev/sdd'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535613466326366', 'path': '/dev/sdd'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.objects.instance [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 19:56:26 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:26 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:56:26 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:56:26 user nova-compute[86931]:   <serial>36ffc78c-2b38-4956-b556-dfcd85bddf64</serial>
Nov 16 19:56:26 user nova-compute[86931]: </disk>
Nov 16 19:56:26 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No BDM found with device name vdc, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] No VIF found with MAC fa:16:3e:e8:a8:33, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:56:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-90b076f3-850f-435f-a23d-a2d1c0786a6e tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.863s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:27 user nova-compute[86931]: INFO nova.compute.manager [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Detaching volume 36ffc78c-2b38-4956-b556-dfcd85bddf64
Nov 16 19:56:27 user nova-compute[86931]: INFO nova.virt.block_device [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attempting to driver detach volume 36ffc78c-2b38-4956-b556-dfcd85bddf64 from mountpoint /dev/vdc
Nov 16 19:56:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Attempting to detach device vdc from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:56:27 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:27 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:56:27 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:56:27 user nova-compute[86931]:   <serial>36ffc78c-2b38-4956-b556-dfcd85bddf64</serial>
Nov 16 19:56:27 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:56:27 user nova-compute[86931]: </disk>
Nov 16 19:56:27 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:56:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully detached device vdc from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the persistent domain config.
Nov 16 19:56:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:56:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:56:27 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:56:27 user nova-compute[86931]:   <source dev="/dev/sdd"/>
Nov 16 19:56:27 user nova-compute[86931]:   <target dev="vdc" bus="virtio"/>
Nov 16 19:56:27 user nova-compute[86931]:   <serial>36ffc78c-2b38-4956-b556-dfcd85bddf64</serial>
Nov 16 19:56:27 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 19:56:27 user nova-compute[86931]: </disk>
Nov 16 19:56:27 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:56:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:56:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:40 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cdd97c19-f165-4c85-892a-8aaf0146da4d is timed out.
Nov 16 19:56:40 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully detached device vdb from instance cdd97c19-f165-4c85-892a-8aaf0146da4d from the live domain config.
Nov 16 19:56:40 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHiVvTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:40 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6d2ebe-65a0-4e90-bbaf-ef8d5febe002]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:56:40 user nova-compute[86931]: No targets found.
Nov 16 19:56:40 user nova-compute[86931]: iSNS:
Nov 16 19:56:40 user nova-compute[86931]: No targets found.
Nov 16 19:56:40 user nova-compute[86931]: STATIC:
Nov 16 19:56:40 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64
Nov 16 19:56:40 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:40 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:40 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822
Nov 16 19:56:40 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:40 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:40 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a
Nov 16 19:56:40 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:40 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:40 user nova-compute[86931]: FIRMWARE:
Nov 16 19:56:40 user nova-compute[86931]: No targets found.
Nov 16 19:56:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:56:40 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:56:40 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec9663-2381-4e6d-8de6-f48bd83d6373]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739e898-b436-42ab-940f-da4bc7999f5d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:40 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:40 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a (non-flash)
Nov 16 19:56:40 user nova-compute[86931]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:40 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c188b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff4960-2ba8-481b-9e56-987a7f42f6ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[33764df1-fadf-41fa-bd6a-870a46029ea5]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eba9c3-ab21-4727-b22d-bd948b36ce68]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f51b22-20ca-4e60-b4d0-88a89ec7f045]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a7fe9-277c-4437-b59d-3f3f8659eb02]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4530079-315d-4517-b1d0-0573fc1c08b8]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260]
Nov 16 19:56:40 user nova-compute[86931]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a, portal: 172.16.0.220,3260] successful.
Nov 16 19:56:40 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:40 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b7455-4cd9-4a5b-a2ea-eeba6b669967]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== disconnect_volume: return (298ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'flavor' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1949fa5f-8011-4d65-bee5-1162ce5fca46 tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.517s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:41 user nova-compute[86931]: INFO nova.compute.manager [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Terminating instance
Nov 16 19:56:41 user nova-compute[86931]: DEBUG nova.compute.manager [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-unplugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] No waiting events found dispatching network-vif-unplugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.compute.manager [req-b17d4815-0385-4056-b47c-bd9ee724f2a1 req-8821e80b-049b-451f-baff-282f252228da service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-unplugged-59baff9d-dba2-4e51-8098-ccbc2b912740 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:56:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Instance destroyed successfully.
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.objects.instance [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lazy-loading 'resources' on Instance uuid cdd97c19-f165-4c85-892a-8aaf0146da4d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1561177812',display_name='tempest-VolumesSnapshotTestJSON-instance-1561177812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1561177812',id=47,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNXKLrFFfHcaacv2HVXb7oQq4tYr+806k4YveDRPe2+433a6ATcMyzvPtr7OnrN9/f1L1gyoedK+UJ2dFBHrz0n5tgNr9ZYF6EdAL7ez/n9G3kwfyV8jeGBIFsd28fhCQ==',key_name='tempest-keypair-1093182424',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2ec08c56b9146afb20e6e03163987de',ramdisk_id='',reservation_id='r-pas9l6w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1737668710',owner_user_name='tempest-VolumesSnapshotTestJSON-1737668710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac61132333854d438aa9d788a4060ee4',uuid=cdd97c19-f165-4c85-892a-8aaf0146da4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converting VIF {"id": "59baff9d-dba2-4e51-8098-ccbc2b912740", "address": "fa:16:3e:10:94:53", "network": {"id": "cb5eb2bf-027e-4f2c-86e2-c44d3600afc8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-644139536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2ec08c56b9146afb20e6e03163987de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59baff9d-db", "ovs_interfaceid": "59baff9d-dba2-4e51-8098-ccbc2b912740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_vif [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59baff9d-db, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b680fe4-ba24-4b37-9afe-88234207a0e7) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:56:42 user nova-compute[86931]: INFO os_vif [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:53,bridge_name='br-int',has_traffic_filtering=True,id=59baff9d-dba2-4e51-8098-ccbc2b912740,network=Network(cb5eb2bf-027e-4f2c-86e2-c44d3600afc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59baff9d-db')
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHiVvTPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[30241a1b-6921-41c4-ad24-319810e40554]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:56:42 user nova-compute[86931]: No targets found.
Nov 16 19:56:42 user nova-compute[86931]: iSNS:
Nov 16 19:56:42 user nova-compute[86931]: No targets found.
Nov 16 19:56:42 user nova-compute[86931]: STATIC:
Nov 16 19:56:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64
Nov 16 19:56:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:42 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822
Nov 16 19:56:42 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:42 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:42 user nova-compute[86931]: FIRMWARE:
Nov 16 19:56:42 user nova-compute[86931]: No targets found.
Nov 16 19:56:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:56:42 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:56:42 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6680d73c-1a38-48c3-a32e-3d58a902032a', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e91103-30ff-4d0e-90e6-39c8bfc1f414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04ecc9-d87e-45c4-b7f1-02acc4dd057b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:42 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:42 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4c467eb0>, {}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Disconnecting from: [] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] <== disconnect_volume: return (65ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:56:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Deleting instance files /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d_del
Nov 16 19:56:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Deletion of /opt/stack/data/nova/instances/cdd97c19-f165-4c85-892a-8aaf0146da4d_del complete
Nov 16 19:56:42 user nova-compute[86931]: INFO nova.compute.manager [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 16 19:56:42 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:56:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:43 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:56:43 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Took 0.65 seconds to deallocate network for instance.
Nov 16 19:56:43 user nova-compute[86931]: WARNING nova.volume.cinder [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Attachment 7bc14bdb-4a3a-47e6-9f57-4753641b9d9f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7bc14bdb-4a3a-47e6-9f57-4753641b9d9f. (HTTP 404) (Request-ID: req-233c1926-e76a-4ad5-b1b1-3f06bc0d902b)
Nov 16 19:56:43 user nova-compute[86931]: INFO nova.compute.manager [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Took 0.02 seconds to detach 1 volumes for instance.
Nov 16 19:56:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:43 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:56:43 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:56:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:43 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Deleted allocations for instance cdd97c19-f165-4c85-892a-8aaf0146da4d
Nov 16 19:56:43 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-d7fa46ac-fe8f-4d29-a51e-3bc33d103fab tempest-VolumesSnapshotTestJSON-1737668710 tempest-VolumesSnapshotTestJSON-1737668710-project-member] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] Acquiring lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:56:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:56:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] Lock "cdd97c19-f165-4c85-892a-8aaf0146da4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] No waiting events found dispatching network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:56:44 user nova-compute[86931]: WARNING nova.compute.manager [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received unexpected event network-vif-plugged-59baff9d-dba2-4e51-8098-ccbc2b912740 for instance with vm_state deleted and task_state None.
Nov 16 19:56:44 user nova-compute[86931]: DEBUG nova.compute.manager [req-1652fd90-0452-4d47-b62c-400a6dfe9076 req-8e9bd989-080f-443f-a1ea-bc0e560384c1 service nova] [instance: cdd97c19-f165-4c85-892a-8aaf0146da4d] Received event network-vif-deleted-59baff9d-dba2-4e51-8098-ccbc2b912740 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:56:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:48 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a2ea45ad-28f1-4738-90c7-dd458e82831c is timed out.
Nov 16 19:56:48 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully detached device vdc from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the live domain config.
Nov 16 19:56:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NofEejRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:56:48 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0afcec-93b9-466c-9937-019454591353]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:56:48 user nova-compute[86931]: No targets found.
Nov 16 19:56:48 user nova-compute[86931]: iSNS:
Nov 16 19:56:48 user nova-compute[86931]: No targets found.
Nov 16 19:56:48 user nova-compute[86931]: STATIC:
Nov 16 19:56:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64
Nov 16 19:56:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:48 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822
Nov 16 19:56:48 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:56:48 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:56:48 user nova-compute[86931]: FIRMWARE:
Nov 16 19:56:48 user nova-compute[86931]: No targets found.
Nov 16 19:56:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:56:48 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:56:48 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71ee8b-43c3-4e1a-9f89-66cefdf34492]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba34a2-daf7-4390-94ad-4c145b3c4708]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:48 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:56:48 user nova-compute[86931]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 (non-flash)
Nov 16 19:56:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5595a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64'): ({'sdd'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Removing single pathed devices sdd {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[af183b5a-05b2-49aa-a516-0afed2f4451f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78636c2-36b2-4d11-a4bd-f92796a83f05]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Flushing IO for device /dev/sdd {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd9726-4ddb-4686-bb23-6c82614819f8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a023797e-9456-4e14-ba57-5760358b5ddd]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] SCSI volumes sdd have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570cb2c-5cd5-4ef5-9256-bcebc2251609]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0c6f0e-a02a-4cc2-b8c6-025e45ea21d2]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260]
Nov 16 19:56:48 user nova-compute[86931]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64, portal: 172.16.0.220,3260] successful.
Nov 16 19:56:48 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ffc78c-2b38-4956-b556-dfcd85bddf64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa276847-c8c4-48db-8a17-bf54e2421715]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== disconnect_volume: return (294ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:56:48 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:56:49 user nova-compute[86931]: DEBUG nova.objects.instance [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:56:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-31c1fe9c-cadf-4b2c-935f-e45295535985 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.685s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:56:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:56:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:03 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:57:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:08 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:57:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:57:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:12 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 19:57:13 user nova-compute[86931]: INFO nova.compute.claims [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Claim successful on node user
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 19:57:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 19:57:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.policy [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df30371454934336b9480fb2daf319c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26f8db82034146c0a37f570bf7e1951e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 19:57:14 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Creating image(s)
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "/opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "/opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "/opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.182s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk 1073741824" returned: 0 in 0.059s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Successfully created port: 7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Cannot resize image /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Ensure instance console log exists: /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:14 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 19:57:15 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:57:15 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.098751068115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a2ea45ad-28f1-4738-90c7-dd458e82831c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 541d5325-bb1a-4c9a-9102-6f534d3395d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Successfully updated port: 7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquired lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-changed-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Refreshing instance network info cache due to event network-changed-7ffda9db-9b68-4099-bc75-2ab067701584. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] Acquiring lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:57:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.neutron [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updating instance_info_cache with network_info: [{"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Releasing lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Instance network_info: |[{"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] Acquired lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Refreshing network info cache for port 7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Start _get_guest_xml network_info=[{"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 19:57:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:57:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-262525333',display_name='tempest-VolumesActionsTest-instance-262525333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-262525333',id=50,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-jamtvnav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:57:14Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=541d5325-bb1a-4c9a-9102-6f534d3395d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.objects.instance [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lazy-loading 'pci_devices' on Instance uuid 541d5325-bb1a-4c9a-9102-6f534d3395d0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 19:57:16 user nova-compute[86931]:   <uuid>541d5325-bb1a-4c9a-9102-6f534d3395d0</uuid>
Nov 16 19:57:16 user nova-compute[86931]:   <name>instance-00000032</name>
Nov 16 19:57:16 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 19:57:16 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 19:57:16 user nova-compute[86931]:   <metadata>
Nov 16 19:57:16 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 19:57:16 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:name>tempest-VolumesActionsTest-instance-262525333</nova:name>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:creationTime>2023-11-16 19:57:16</nova:creationTime>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 19:57:16 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 19:57:16 user nova-compute[86931]:       </nova:flavor>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:owner>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:user uuid="df30371454934336b9480fb2daf319c8">tempest-VolumesActionsTest-1471119215-project-member</nova:user>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:project uuid="26f8db82034146c0a37f570bf7e1951e">tempest-VolumesActionsTest-1471119215</nova:project>
Nov 16 19:57:16 user nova-compute[86931]:       </nova:owner>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 19:57:16 user nova-compute[86931]:       <nova:ports>
Nov 16 19:57:16 user nova-compute[86931]:         <nova:port uuid="7ffda9db-9b68-4099-bc75-2ab067701584">
Nov 16 19:57:16 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 19:57:16 user nova-compute[86931]:         </nova:port>
Nov 16 19:57:16 user nova-compute[86931]:       </nova:ports>
Nov 16 19:57:16 user nova-compute[86931]:     </nova:instance>
Nov 16 19:57:16 user nova-compute[86931]:   </metadata>
Nov 16 19:57:16 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 19:57:16 user nova-compute[86931]:     <system>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="serial">541d5325-bb1a-4c9a-9102-6f534d3395d0</entry>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="uuid">541d5325-bb1a-4c9a-9102-6f534d3395d0</entry>
Nov 16 19:57:16 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 19:57:16 user nova-compute[86931]:     </system>
Nov 16 19:57:16 user nova-compute[86931]:   </sysinfo>
Nov 16 19:57:16 user nova-compute[86931]:   <os>
Nov 16 19:57:16 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 19:57:16 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 19:57:16 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 19:57:16 user nova-compute[86931]:   </os>
Nov 16 19:57:16 user nova-compute[86931]:   <features>
Nov 16 19:57:16 user nova-compute[86931]:     <acpi/>
Nov 16 19:57:16 user nova-compute[86931]:     <apic/>
Nov 16 19:57:16 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 19:57:16 user nova-compute[86931]:   </features>
Nov 16 19:57:16 user nova-compute[86931]:   <clock offset="utc">
Nov 16 19:57:16 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 19:57:16 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 19:57:16 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 19:57:16 user nova-compute[86931]:   </clock>
Nov 16 19:57:16 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 19:57:16 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 19:57:16 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 19:57:16 user nova-compute[86931]:   </cpu>
Nov 16 19:57:16 user nova-compute[86931]:   <devices>
Nov 16 19:57:16 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 19:57:16 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 19:57:16 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk"/>
Nov 16 19:57:16 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 19:57:16 user nova-compute[86931]:     </disk>
Nov 16 19:57:16 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 19:57:16 user nova-compute[86931]:       <mac address="fa:16:3e:82:ed:d3"/>
Nov 16 19:57:16 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:57:16 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 19:57:16 user nova-compute[86931]:       <target dev="tap7ffda9db-9b"/>
Nov 16 19:57:16 user nova-compute[86931]:     </interface>
Nov 16 19:57:16 user nova-compute[86931]:     <serial type="pty">
Nov 16 19:57:16 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/console.log" append="off"/>
Nov 16 19:57:16 user nova-compute[86931]:     </serial>
Nov 16 19:57:16 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 19:57:16 user nova-compute[86931]:     <video>
Nov 16 19:57:16 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 19:57:16 user nova-compute[86931]:     </video>
Nov 16 19:57:16 user nova-compute[86931]:     <rng model="virtio">
Nov 16 19:57:16 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 19:57:16 user nova-compute[86931]:     </rng>
Nov 16 19:57:16 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 19:57:16 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 19:57:16 user nova-compute[86931]:       <stats period="10"/>
Nov 16 19:57:16 user nova-compute[86931]:     </memballoon>
Nov 16 19:57:16 user nova-compute[86931]:   </devices>
Nov 16 19:57:16 user nova-compute[86931]: </domain>
Nov 16 19:57:16 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-262525333',display_name='tempest-VolumesActionsTest-instance-262525333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-262525333',id=50,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-jamtvnav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T19:57:14Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=541d5325-bb1a-4c9a-9102-6f534d3395d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG os_vif [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e377120-0f19-5688-9fca-a94505cd9cc1', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ffda9db-9b, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ffda9db-9b, col_values=(('qos', UUID('979c48a9-0500-4b9b-a6c8-ce611889c51d')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ffda9db-9b, col_values=(('external_ids', {'iface-id': '7ffda9db-9b68-4099-bc75-2ab067701584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:ed:d3', 'vm-uuid': '541d5325-bb1a-4c9a-9102-6f534d3395d0'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:16 user nova-compute[86931]: INFO os_vif [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b')
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] No VIF found with MAC fa:16:3e:82:ed:d3, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updated VIF entry in instance network info cache for port 7ffda9db-9b68-4099-bc75-2ab067701584. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG nova.network.neutron [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updating instance_info_cache with network_info: [{"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-45501d45-088c-445d-a92e-188eba871d1f req-b8942344-55ab-4887-bd2f-f7b8854a43ff service nova] Releasing lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:57:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:17 user nova-compute[86931]: DEBUG nova.compute.manager [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] No waiting events found dispatching network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:57:17 user nova-compute[86931]: WARNING nova.compute.manager [req-89ebab6b-afe9-47e6-acfa-65be60d4283e req-eb82c9d0-8af6-499a-9de3-2ac4397f0f29 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received unexpected event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 for instance with vm_state building and task_state spawning.
Nov 16 19:57:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:18 user nova-compute[86931]: INFO nova.compute.manager [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Detaching volume 71b2f754-94d4-432f-ab28-8416b7f14822
Nov 16 19:57:18 user nova-compute[86931]: INFO nova.virt.block_device [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Attempting to driver detach volume 71b2f754-94d4-432f-ab28-8416b7f14822 from mountpoint /dev/vdb
Nov 16 19:57:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Attempting to detach device vdb from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:57:18 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:57:18 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:57:18 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:57:18 user nova-compute[86931]:   <serial>71b2f754-94d4-432f-ab28-8416b7f14822</serial>
Nov 16 19:57:18 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:57:18 user nova-compute[86931]: </disk>
Nov 16 19:57:18 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:57:18 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully detached device vdb from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the persistent domain config.
Nov 16 19:57:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 19:57:18 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 19:57:18 user nova-compute[86931]:   <source dev="/dev/sdc"/>
Nov 16 19:57:18 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 19:57:18 user nova-compute[86931]:   <serial>71b2f754-94d4-432f-ab28-8416b7f14822</serial>
Nov 16 19:57:18 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 19:57:18 user nova-compute[86931]: </disk>
Nov 16 19:57:18 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 19:57:18 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 19:57:19 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Instance spawned successfully.
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 19:57:19 user nova-compute[86931]: INFO nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:19 user nova-compute[86931]: DEBUG nova.compute.manager [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] No waiting events found dispatching network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:57:19 user nova-compute[86931]: WARNING nova.compute.manager [req-0fa7408e-bb5d-4091-89fc-9a6fbda9fc1d req-392e839c-5dd1-4b78-8267-5594f0d07d30 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received unexpected event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 for instance with vm_state building and task_state spawning.
Nov 16 19:57:19 user nova-compute[86931]: INFO nova.compute.manager [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Took 6.25 seconds to build instance.
Nov 16 19:57:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-3763e46b-e8b0-4ca2-be88-c820bc9cc56e tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.359s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Verify base images {{(pid=86931) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Image id 04ef6bdb-1977-4f57-a0fb-6742ffba000b yields fingerprint b75a4bc4c7b3b292e087b5300496870d9005ec93 {{(pid=86931) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 19:57:31 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] image 04ef6bdb-1977-4f57-a0fb-6742ffba000b at (/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93): checking
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] image 04ef6bdb-1977-4f57-a0fb-6742ffba000b at (/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93): image is in use {{(pid=86931) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=86931) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] a2ea45ad-28f1-4738-90c7-dd458e82831c is a valid instance name {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] a2ea45ad-28f1-4738-90c7-dd458e82831c has a disk file {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a2ea45ad-28f1-4738-90c7-dd458e82831c is backed by b75a4bc4c7b3b292e087b5300496870d9005ec93 {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] 541d5325-bb1a-4c9a-9102-6f534d3395d0 is a valid instance name {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] 541d5325-bb1a-4c9a-9102-6f534d3395d0 has a disk file {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 19:57:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:32 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 541d5325-bb1a-4c9a-9102-6f534d3395d0 is backed by b75a4bc4c7b3b292e087b5300496870d9005ec93 {{(pid=86931) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9
Nov 16 19:57:32 user nova-compute[86931]: WARNING nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Active base files: /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Removable base files: /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35 /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932 /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8 /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9 /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c66db38d103e721396c71f0d3a845a9ab924d5ce
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3bb88851fa63486419133e2b66fa4b740823c4b
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2baaeb9a868e589b30e9420b7fff833ba8f27e35
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c730a6b6b60a4890af7e5b6e5fbfddc55e6438ad
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c866a8da8354f91287dafbf5b87037efb6afe932
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bbfacaed0bac32dbd84d7118038323800eddc2b8
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c59bd98eaf98a00063e5e69e39f9fe713e67279f
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a9bcc6027c8cca695c1d042567d44bf1f15edde9
Nov 16 19:57:32 user nova-compute[86931]: INFO nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eeeae1fc4d80004c480a98c4a9d96ca8c0b843f8
Nov 16 19:57:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Verification complete {{(pid=86931) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 19:57:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Verify swap images {{(pid=86931) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 19:57:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.imagecache [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Verify ephemeral images {{(pid=86931) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 19:57:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:57:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:38 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2ea45ad-28f1-4738-90c7-dd458e82831c is timed out.
Nov 16 19:57:38 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully detached device vdb from instance a2ea45ad-28f1-4738-90c7-dd458e82831c from the live domain config.
Nov 16 19:57:38 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOZcXqQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 19:57:38 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116cc11-6e9f-43b5-a659-2f5829c62781]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 19:57:38 user nova-compute[86931]: No targets found.
Nov 16 19:57:38 user nova-compute[86931]: iSNS:
Nov 16 19:57:38 user nova-compute[86931]: No targets found.
Nov 16 19:57:38 user nova-compute[86931]: STATIC:
Nov 16 19:57:38 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822
Nov 16 19:57:38 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 19:57:38 user nova-compute[86931]:                 Iface Name: default
Nov 16 19:57:38 user nova-compute[86931]: FIRMWARE:
Nov 16 19:57:38 user nova-compute[86931]: No targets found.
Nov 16 19:57:38 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 19:57:38 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 19:57:38 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[50133df4-c461-44a1-ba1a-c08886bffb3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:38 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9848bf-ffbe-444d-b0d5-46b994233750]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:57:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 (non-flash)
Nov 16 19:57:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c453eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822'): ({'sdc'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Removing single pathed devices sdc {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765b46f-0f2b-44e2-aa56-33f8b2db6e92]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[086e712b-1540-4c9d-9185-3c1f1921e187]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Flushing IO for device /dev/sdc {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[069994dc-33a8-4894-8716-064c13975f84]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab86a1d5-b4d1-4008-9e03-458af4c59004]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] SCSI volumes sdc have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b520685e-e75a-44b3-909d-04f4e092039a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[11607e23-87a8-4390-8809-781188625d0c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260]
Nov 16 19:57:39 user nova-compute[86931]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822, portal: 172.16.0.220,3260] successful.
Nov 16 19:57:39 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b2f754-94d4-432f-ab28-8416b7f14822 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a9022e-693c-4d0d-82c2-4b6062e7435d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] <== disconnect_volume: return (321ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 19:57:39 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 19:57:40 user nova-compute[86931]: DEBUG nova.objects.instance [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'flavor' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:57:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-c6071364-a0f2-47b9-a863-01c3437f9cb3 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.710s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:57:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:46 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:51 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:57:56 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:01 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:06 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:08 user nova-compute[86931]: INFO nova.compute.manager [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Terminating instance
Nov 16 19:58:08 user nova-compute[86931]: DEBUG nova.compute.manager [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:08 user nova-compute[86931]: DEBUG nova.compute.manager [req-bfe6fa45-6062-486e-80ee-ad4569c16585 req-014a7ef5-3df0-465b-8b22-112bc07a3ecb service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Instance destroyed successfully.
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.objects.instance [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lazy-loading 'resources' on Instance uuid a2ea45ad-28f1-4738-90c7-dd458e82831c {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:54:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1066738290',display_name='tempest-TestServerVolumeAttachmentScenario-server-1066738290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1066738290',id=48,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz7RfJBAyekUafOnWgp5G91H8LC+3166WxSrhYj+hVDXoDNkXkVEeCrnFhRWAi+EY4z6naqs9MD1UaviDdMy9YVj9RoXOKbITdC/1pbGHXUrKH/ChG0IOhHsZr4COQs+g==',key_name='tempest-keypair-90227124',keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:54:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe1ca75509e845a2a44c9b32abf93f49',ramdisk_id='',reservation_id='r-ym2o7bms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1871059517',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1871059517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae1da504c7b4d27b56fcffc473b63cb',uuid=a2ea45ad-28f1-4738-90c7-dd458e82831c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converting VIF {"id": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "address": "fa:16:3e:e8:a8:33", "network": {"id": "bd8c86dc-6b78-4878-b0b4-5379036654ac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1570011806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1ca75509e845a2a44c9b32abf93f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767df5c2-db", "ovs_interfaceid": "767df5c2-dbc9-4050-9907-e76ae7a60d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG os_vif [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap767df5c2-db, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93d3c96f-cfdc-4e8f-b17f-69649a33965b) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:09 user nova-compute[86931]: INFO os_vif [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a8:33,bridge_name='br-int',has_traffic_filtering=True,id=767df5c2-dbc9-4050-9907-e76ae7a60d26,network=Network(bd8c86dc-6b78-4878-b0b4-5379036654ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767df5c2-db')
Nov 16 19:58:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Deleting instance files /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c_del
Nov 16 19:58:09 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Deletion of /opt/stack/data/nova/instances/a2ea45ad-28f1-4738-90c7-dd458e82831c_del complete
Nov 16 19:58:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:09 user nova-compute[86931]: INFO nova.compute.manager [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 19:58:09 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:58:09 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:58:10 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Took 0.77 seconds to deallocate network for instance.
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-dbba34c8-2166-402a-8b92-68241737a453 req-f77d02a1-d427-4f97-96f7-1f666ded7e11 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-deleted-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:10 user nova-compute[86931]: INFO nova.compute.manager [req-dbba34c8-2166-402a-8b92-68241737a453 req-f77d02a1-d427-4f97-96f7-1f666ded7e11 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Neutron deleted interface 767df5c2-dbc9-4050-9907-e76ae7a60d26; detaching it from the instance and deleting it from the info cache
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.network.neutron [req-dbba34c8-2166-402a-8b92-68241737a453 req-f77d02a1-d427-4f97-96f7-1f666ded7e11 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.manager [req-dbba34c8-2166-402a-8b92-68241737a453 req-f77d02a1-d427-4f97-96f7-1f666ded7e11 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Detach interface failed, port_id=767df5c2-dbc9-4050-9907-e76ae7a60d26, reason: Instance a2ea45ad-28f1-4738-90c7-dd458e82831c could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 541d5325-bb1a-4c9a-9102-6f534d3395d0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:10 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Deleted allocations for instance a2ea45ad-28f1-4738-90c7-dd458e82831c
Nov 16 19:58:10 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-70077d47-0b29-46ad-8729-f78914839848 tempest-TestServerVolumeAttachmentScenario-1871059517 tempest-TestServerVolumeAttachmentScenario-1871059517-project-member] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:11 user nova-compute[86931]: WARNING nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state deleted and task_state None.
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:11 user nova-compute[86931]: WARNING nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state deleted and task_state None.
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:11 user nova-compute[86931]: WARNING nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state deleted and task_state None.
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:11 user nova-compute[86931]: WARNING nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-unplugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state deleted and task_state None.
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Acquiring lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] Lock "a2ea45ad-28f1-4738-90c7-dd458e82831c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] No waiting events found dispatching network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:58:11 user nova-compute[86931]: WARNING nova.compute.manager [req-88f0c336-5bf8-4593-a681-24de2190f383 req-64f92450-9c77-4239-8f75-256d98c5c426 service nova] [instance: a2ea45ad-28f1-4738-90c7-dd458e82831c] Received unexpected event network-vif-plugged-767df5c2-dbc9-4050-9907-e76ae7a60d26 for instance with vm_state deleted and task_state None.
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updating instance_info_cache with network_info: [{"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-541d5325-bb1a-4c9a-9102-6f534d3395d0" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:58:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:58:15 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 19:58:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:58:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.096359252929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 541d5325-bb1a-4c9a-9102-6f534d3395d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:58:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:26 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 541d5325-bb1a-4c9a-9102-6f534d3395d0 {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 19:58:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:58:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:58:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:58:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:58:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 19:58:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:58:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:58:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:58:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:04 user nova-compute[86931]: INFO nova.compute.manager [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Terminating instance
Nov 16 19:59:04 user nova-compute[86931]: DEBUG nova.compute.manager [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-unplugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] No waiting events found dispatching network-vif-unplugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:59:04 user nova-compute[86931]: DEBUG nova.compute.manager [req-7a5f8f35-68ea-4529-a8aa-2d406ad1d3a9 req-8757406d-50f3-409d-ac13-a89feacda58a service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-unplugged-7ffda9db-9b68-4099-bc75-2ab067701584 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Instance destroyed successfully.
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.objects.instance [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lazy-loading 'resources' on Instance uuid 541d5325-bb1a-4c9a-9102-6f534d3395d0 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T19:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-262525333',display_name='tempest-VolumesActionsTest-instance-262525333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-262525333',id=50,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T19:57:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26f8db82034146c0a37f570bf7e1951e',ramdisk_id='',reservation_id='r-jamtvnav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1471119215',owner_user_name='tempest-VolumesActionsTest-1471119215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T19:57:20Z,user_data=None,user_id='df30371454934336b9480fb2daf319c8',uuid=541d5325-bb1a-4c9a-9102-6f534d3395d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converting VIF {"id": "7ffda9db-9b68-4099-bc75-2ab067701584", "address": "fa:16:3e:82:ed:d3", "network": {"id": "a4aceb17-283c-4155-a160-e23e91e7a126", "bridge": "br-int", "label": "tempest-VolumesActionsTest-387080858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26f8db82034146c0a37f570bf7e1951e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ffda9db-9b", "ovs_interfaceid": "7ffda9db-9b68-4099-bc75-2ab067701584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG os_vif [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ffda9db-9b, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=979c48a9-0500-4b9b-a6c8-ce611889c51d) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:05 user nova-compute[86931]: INFO os_vif [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=7ffda9db-9b68-4099-bc75-2ab067701584,network=Network(a4aceb17-283c-4155-a160-e23e91e7a126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ffda9db-9b')
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Deleting instance files /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0_del
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Deletion of /opt/stack/data/nova/instances/541d5325-bb1a-4c9a-9102-6f534d3395d0_del complete
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.compute.manager [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 19:59:05 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Took 0.65 seconds to deallocate network for instance.
Nov 16 19:59:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:59:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:05 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Deleted allocations for instance 541d5325-bb1a-4c9a-9102-6f534d3395d0
Nov 16 19:59:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-82e0c16e-027c-4264-bb84-fa0191206bf9 tempest-VolumesActionsTest-1471119215 tempest-VolumesActionsTest-1471119215-project-member] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.812s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:59:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] Acquiring lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:06 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] Lock "541d5325-bb1a-4c9a-9102-6f534d3395d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] No waiting events found dispatching network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 19:59:06 user nova-compute[86931]: WARNING nova.compute.manager [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received unexpected event network-vif-plugged-7ffda9db-9b68-4099-bc75-2ab067701584 for instance with vm_state deleted and task_state None.
Nov 16 19:59:06 user nova-compute[86931]: DEBUG nova.compute.manager [req-333ac1e9-8413-4e8c-830c-06463d346b1f req-b08b3e1c-b0eb-421c-9f07-b6ac76e51a45 service nova] [instance: 541d5325-bb1a-4c9a-9102-6f534d3395d0] Received event network-vif-deleted-7ffda9db-9b68-4099-bc75-2ab067701584 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 19:59:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 19:59:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 19:59:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 19:59:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:59:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.12298583984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 19:59:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 19:59:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 19:59:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:59:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 19:59:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:15 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:00:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:00:16 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=24.177207946777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:00:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:00:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:00:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 20:00:30 user nova-compute[86931]: INFO nova.compute.claims [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Claim successful on node user
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 20:00:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 20:00:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Creating image(s)
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "/opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "/opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG nova.policy [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16ee173498fe464db9c02ea14f7e4c33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41e384635f2f483ab08fc9f4e43b255b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.187s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk 1073741824" returned: 0 in 0.046s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Successfully created port: 6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Cannot resize image /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Ensure instance console log exists: /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Successfully updated port: 6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquired lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-changed-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Refreshing instance network info cache due to event network-changed-6620df26-feb8-493b-9fce-c7574b3a6ae0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:00:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] Acquiring lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.neutron [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Releasing lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Instance network_info: |[{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] Acquired lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Refreshing network info cache for port 6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Start _get_guest_xml network_info=[{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 20:00:32 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:00:32 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-683776793',display_name='tempest-VolumesNegativeTest-instance-683776793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-683776793',id=51,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41e384635f2f483ab08fc9f4e43b255b',ramdisk_id='',reservation_id='r-ixgmqghz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1249534867',owner_user_name='tempest-VolumesNegativeTest-1249534867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:00:30Z,user_data=None,user_id='16ee173498fe464db9c02ea14f7e4c33',uuid=a3aedb86-78f3-484f-82e5-49ba6c205b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converting VIF {"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lazy-loading 'pci_devices' on Instance uuid a3aedb86-78f3-484f-82e5-49ba6c205b83 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] End _get_guest_xml xml=<domain type="kvm">
Nov 16 20:00:32 user nova-compute[86931]:   <uuid>a3aedb86-78f3-484f-82e5-49ba6c205b83</uuid>
Nov 16 20:00:32 user nova-compute[86931]:   <name>instance-00000033</name>
Nov 16 20:00:32 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 20:00:32 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 20:00:32 user nova-compute[86931]:   <metadata>
Nov 16 20:00:32 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 20:00:32 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:name>tempest-VolumesNegativeTest-instance-683776793</nova:name>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:creationTime>2023-11-16 20:00:32</nova:creationTime>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 20:00:32 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 20:00:32 user nova-compute[86931]:       </nova:flavor>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:owner>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:user uuid="16ee173498fe464db9c02ea14f7e4c33">tempest-VolumesNegativeTest-1249534867-project-member</nova:user>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:project uuid="41e384635f2f483ab08fc9f4e43b255b">tempest-VolumesNegativeTest-1249534867</nova:project>
Nov 16 20:00:32 user nova-compute[86931]:       </nova:owner>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 20:00:32 user nova-compute[86931]:       <nova:ports>
Nov 16 20:00:32 user nova-compute[86931]:         <nova:port uuid="6620df26-feb8-493b-9fce-c7574b3a6ae0">
Nov 16 20:00:32 user nova-compute[86931]:           <nova:ip type="fixed" address="192.168.233.121" ipVersion="4"/>
Nov 16 20:00:32 user nova-compute[86931]:         </nova:port>
Nov 16 20:00:32 user nova-compute[86931]:       </nova:ports>
Nov 16 20:00:32 user nova-compute[86931]:     </nova:instance>
Nov 16 20:00:32 user nova-compute[86931]:   </metadata>
Nov 16 20:00:32 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 20:00:32 user nova-compute[86931]:     <system>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="serial">a3aedb86-78f3-484f-82e5-49ba6c205b83</entry>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="uuid">a3aedb86-78f3-484f-82e5-49ba6c205b83</entry>
Nov 16 20:00:32 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 20:00:32 user nova-compute[86931]:     </system>
Nov 16 20:00:32 user nova-compute[86931]:   </sysinfo>
Nov 16 20:00:32 user nova-compute[86931]:   <os>
Nov 16 20:00:32 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 20:00:32 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 20:00:32 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 20:00:32 user nova-compute[86931]:   </os>
Nov 16 20:00:32 user nova-compute[86931]:   <features>
Nov 16 20:00:32 user nova-compute[86931]:     <acpi/>
Nov 16 20:00:32 user nova-compute[86931]:     <apic/>
Nov 16 20:00:32 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 20:00:32 user nova-compute[86931]:   </features>
Nov 16 20:00:32 user nova-compute[86931]:   <clock offset="utc">
Nov 16 20:00:32 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 20:00:32 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 20:00:32 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 20:00:32 user nova-compute[86931]:   </clock>
Nov 16 20:00:32 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 20:00:32 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 20:00:32 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 20:00:32 user nova-compute[86931]:   </cpu>
Nov 16 20:00:32 user nova-compute[86931]:   <devices>
Nov 16 20:00:32 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 20:00:32 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 20:00:32 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk"/>
Nov 16 20:00:32 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 20:00:32 user nova-compute[86931]:     </disk>
Nov 16 20:00:32 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 20:00:32 user nova-compute[86931]:       <mac address="fa:16:3e:1c:05:bc"/>
Nov 16 20:00:32 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:00:32 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 20:00:32 user nova-compute[86931]:       <target dev="tap6620df26-fe"/>
Nov 16 20:00:32 user nova-compute[86931]:     </interface>
Nov 16 20:00:32 user nova-compute[86931]:     <serial type="pty">
Nov 16 20:00:32 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/console.log" append="off"/>
Nov 16 20:00:32 user nova-compute[86931]:     </serial>
Nov 16 20:00:32 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 20:00:32 user nova-compute[86931]:     <video>
Nov 16 20:00:32 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:00:32 user nova-compute[86931]:     </video>
Nov 16 20:00:32 user nova-compute[86931]:     <rng model="virtio">
Nov 16 20:00:32 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 20:00:32 user nova-compute[86931]:     </rng>
Nov 16 20:00:32 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 20:00:32 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 20:00:32 user nova-compute[86931]:       <stats period="10"/>
Nov 16 20:00:32 user nova-compute[86931]:     </memballoon>
Nov 16 20:00:32 user nova-compute[86931]:   </devices>
Nov 16 20:00:32 user nova-compute[86931]: </domain>
Nov 16 20:00:32 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-683776793',display_name='tempest-VolumesNegativeTest-instance-683776793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-683776793',id=51,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41e384635f2f483ab08fc9f4e43b255b',ramdisk_id='',reservation_id='r-ixgmqghz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1249534867',owner_user_name='tempest-VolumesNegativeTest-1249534867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:00:30Z,user_data=None,user_id='16ee173498fe464db9c02ea14f7e4c33',uuid=a3aedb86-78f3-484f-82e5-49ba6c205b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converting VIF {"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG os_vif [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a81f9f04-51da-53c7-bc83-c6c874b04311', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6620df26-fe, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6620df26-fe, col_values=(('qos', UUID('db5f5873-3820-4098-88a5-1647bbc145de')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6620df26-fe, col_values=(('external_ids', {'iface-id': '6620df26-feb8-493b-9fce-c7574b3a6ae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:05:bc', 'vm-uuid': 'a3aedb86-78f3-484f-82e5-49ba6c205b83'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:32 user nova-compute[86931]: INFO os_vif [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe')
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] No VIF found with MAC fa:16:3e:1c:05:bc, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updated VIF entry in instance network info cache for port 6620df26-feb8-493b-9fce-c7574b3a6ae0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG nova.network.neutron [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:00:32 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-6ffdde78-4388-4fe1-a7fe-de71dafb7131 req-a30c8a81-7032-4ac2-876a-38e3f8b88147 service nova] Releasing lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:00:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:35 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:35 user nova-compute[86931]: DEBUG nova.compute.manager [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] No waiting events found dispatching network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:00:35 user nova-compute[86931]: WARNING nova.compute.manager [req-0c0ee0c4-24a0-4fcd-87f7-c5e5f226733b req-ae1a6fda-d718-4977-849b-01ce699ac782 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received unexpected event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 for instance with vm_state building and task_state spawning.
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 20:00:36 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Instance spawned successfully.
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:00:36 user nova-compute[86931]: INFO nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 16 20:00:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 20:00:36 user nova-compute[86931]: INFO nova.compute.manager [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Took 6.70 seconds to build instance.
Nov 16 20:00:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1b0c39b3-3480-4907-bcd6-de182c0c561b tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG nova.compute.manager [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] No waiting events found dispatching network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:00:37 user nova-compute[86931]: WARNING nova.compute.manager [req-49ad408e-2714-4f9b-b5dd-75cd3bd5d361 req-91659aec-be1c-4af2-8b78-a229752348f7 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received unexpected event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 for instance with vm_state active and task_state None.
Nov 16 20:00:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:00:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:00:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:05 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:01:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid a3aedb86-78f3-484f-82e5-49ba6c205b83 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:01:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:01:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:01:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:01:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:01:16 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:01:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:01:17 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.08438491821289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a3aedb86-78f3-484f-82e5-49ba6c205b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:01:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:01:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:01:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:01:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:01:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:01:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:10 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:02:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid a3aedb86-78f3-484f-82e5-49ba6c205b83 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:02:14 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [{"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:02:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-a3aedb86-78f3-484f-82e5-49ba6c205b83" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:02:14 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:02:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:02:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:02:18 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:02:19 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:02:19 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.083751678466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance a3aedb86-78f3-484f-82e5-49ba6c205b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:02:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:20 user nova-compute[86931]: INFO nova.compute.manager [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Terminating instance
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-unplugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] No waiting events found dispatching network-vif-unplugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [req-707445b8-e396-4fc9-95b6-b27d00481395 req-df55173b-c9ce-4d01-a3ae-fae1e3266b81 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-unplugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:02:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Instance destroyed successfully.
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.objects.instance [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lazy-loading 'resources' on Instance uuid a3aedb86-78f3-484f-82e5-49ba6c205b83 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-683776793',display_name='tempest-VolumesNegativeTest-instance-683776793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-683776793',id=51,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41e384635f2f483ab08fc9f4e43b255b',ramdisk_id='',reservation_id='r-ixgmqghz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1249534867',owner_user_name='tempest-VolumesNegativeTest-1249534867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:00:37Z,user_data=None,user_id='16ee173498fe464db9c02ea14f7e4c33',uuid=a3aedb86-78f3-484f-82e5-49ba6c205b83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converting VIF {"id": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "address": "fa:16:3e:1c:05:bc", "network": {"id": "906c12f7-d560-4446-8f1b-4df824585c55", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "94855b19cd954f58abafb7a3a4fe23aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6620df26-fe", "ovs_interfaceid": "6620df26-feb8-493b-9fce-c7574b3a6ae0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG os_vif [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6620df26-fe, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db5f5873-3820-4098-88a5-1647bbc145de) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:20 user nova-compute[86931]: INFO os_vif [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:05:bc,bridge_name='br-int',has_traffic_filtering=True,id=6620df26-feb8-493b-9fce-c7574b3a6ae0,network=Network(906c12f7-d560-4446-8f1b-4df824585c55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6620df26-fe')
Nov 16 20:02:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Deleting instance files /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83_del
Nov 16 20:02:20 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Deletion of /opt/stack/data/nova/instances/a3aedb86-78f3-484f-82e5-49ba6c205b83_del complete
Nov 16 20:02:20 user nova-compute[86931]: INFO nova.compute.manager [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 20:02:20 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 20:02:20 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:02:21 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Took 0.38 seconds to deallocate network for instance.
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-5b4f64b6-4f44-40f7-8ada-5c5ddbb9b43e req-e23e9700-3d44-49fd-b4ec-e9a413ba42a4 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-deleted-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:02:21 user nova-compute[86931]: INFO nova.compute.manager [req-5b4f64b6-4f44-40f7-8ada-5c5ddbb9b43e req-e23e9700-3d44-49fd-b4ec-e9a413ba42a4 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Neutron deleted interface 6620df26-feb8-493b-9fce-c7574b3a6ae0; detaching it from the instance and deleting it from the info cache
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.network.neutron [req-5b4f64b6-4f44-40f7-8ada-5c5ddbb9b43e req-e23e9700-3d44-49fd-b4ec-e9a413ba42a4 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.compute.manager [req-5b4f64b6-4f44-40f7-8ada-5c5ddbb9b43e req-e23e9700-3d44-49fd-b4ec-e9a413ba42a4 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Detach interface failed, port_id=6620df26-feb8-493b-9fce-c7574b3a6ae0, reason: Instance a3aedb86-78f3-484f-82e5-49ba6c205b83 could not be found. {{(pid=86931) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:21 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Deleted allocations for instance a3aedb86-78f3-484f-82e5-49ba6c205b83
Nov 16 20:02:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-94398755-e9c7-42e0-9ed1-00de76b0450a tempest-VolumesNegativeTest-1249534867 tempest-VolumesNegativeTest-1249534867-project-member] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.385s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:02:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:02:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] Acquiring lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:02:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:02:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] Lock "a3aedb86-78f3-484f-82e5-49ba6c205b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:02:22 user nova-compute[86931]: DEBUG nova.compute.manager [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] No waiting events found dispatching network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:02:22 user nova-compute[86931]: WARNING nova.compute.manager [req-0b622212-f011-44dc-83b5-5f4a63a93b5d req-aedce4ff-16b9-4e16-a622-6d6c434a15c1 service nova] [instance: a3aedb86-78f3-484f-82e5-49ba6c205b83] Received unexpected event network-vif-plugged-6620df26-feb8-493b-9fce-c7574b3a6ae0 for instance with vm_state deleted and task_state None.
Nov 16 20:02:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:02:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:02:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:03:07 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:12 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:03:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:03:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:03:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9161MB free_disk=25.1103515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:21 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:26 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 20:03:36 user nova-compute[86931]: INFO nova.compute.claims [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Claim successful on node user
Nov 16 20:03:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 20:03:36 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 20:03:37 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.policy [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbf47ae1fe0d48bd894864c3548d2cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7457e2e1c5042d4afef7443cf7623c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 20:03:37 user nova-compute[86931]: INFO nova.virt.block_device [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Booting with volume fca6b880-88f3-4e0a-b45b-9087da532c24 at /dev/vda
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.utils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef5e48-f9d5-4a20-a54d-6dc97e85d2eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[495cfb39-b304-464f-a7e5-2a3fdff8519a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.082s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b184df4-e7c6-4288-80a0-285959bf9564]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29d2b13-22f0-44ae-8f56-03e90463b9b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:03:37 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:03:37 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6008210-ab9b-44ea-a79b-6fdb66a70a7d]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG os_brick.utils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating existing volume attachment record: 04c1bf79-abb8-4100-8358-160ec2f4db6f {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:37 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Successfully created port: 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Successfully updated port: 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.compute.manager [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing instance network info cache due to event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.network.neutron [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance network_info: |[{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:03:38 user nova-compute[86931]: DEBUG nova.network.neutron [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:03:39 user nova-compute[86931]: DEBUG nova.network.neutron [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated VIF entry in instance network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:03:39 user nova-compute[86931]: DEBUG nova.network.neutron [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:03:39 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-999276be-fb0b-4ce3-af7a-9e2f3fb8a373 req-03b4df1a-b63d-4666-82b2-9151629e3019 service nova] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:03:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 20:03:42 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Creating image(s)
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Ensure instance console log exists: /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start _get_guest_xml network_info=[{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '04c1bf79-abb8-4100-8358-160ec2f4db6f', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42e20686-f534-460c-afa7-f0ee2efefc5d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fca6b880-88f3-4e0a-b45b-9087da532c24', 'serial': 'fca6b880-88f3-4e0a-b45b-9087da532c24'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 20:03:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:03:42 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:03:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:03:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:03:42 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d1e15-2021-4928-b8ac-05b6a443e67e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:03:42 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[85017500-3dfd-4086-a5a1-ebbe2e6a2d9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24] added
Nov 16 20:03:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f716374-adbf-42c2-965b-807526530434]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[651e0db2-d6df-471e-9a65-a9de3ea24bfe]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUWPOLJm {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUWPOLJm" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f675c-c2f8-4c52-ab42-4f9263c75780]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUWPOLJm'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0152d0-2e1d-471a-bf3c-d1d521024c0a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[34930fd5-35ba-4345-a451-fc6549980ef9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:03:42 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:03:42 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:03:42 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:03:42 user nova-compute[86931]: 
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55aa709-14ae-4838-8aa6-eb92407178bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]
Nov 16 20:03:42 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.
Nov 16 20:03:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4cd547-e78a-469e-b1aa-b5284a41b4e8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b1970-2169-492f-9f4e-63ae57271513]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:03:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:03:42 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79396a5-4638-4688-b168-b53ef30579e3]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:03:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23337306130666138', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337306130666138', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuOiKKGZH73nhWeGKaryNwBvydFyynQmMVIOBeVKuA/HJVOPCIT8Jsya3Tk8fM3F8dW4eKVmeNMXKbOgrkjBVHsrZSL+O/sdcY4XpL570k8AzyLSKTnVHp2v2eNN/9UGA==',key_name='tempest-TestShelveInstance-439392724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:03:37Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.objects.instance [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 20:03:43 user nova-compute[86931]:   <uuid>42e20686-f534-460c-afa7-f0ee2efefc5d</uuid>
Nov 16 20:03:43 user nova-compute[86931]:   <name>instance-00000034</name>
Nov 16 20:03:43 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 20:03:43 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 20:03:43 user nova-compute[86931]:   <metadata>
Nov 16 20:03:43 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 20:03:43 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 20:03:43 user nova-compute[86931]:       <nova:name>tempest-TestShelveInstance-server-992236114</nova:name>
Nov 16 20:03:43 user nova-compute[86931]:       <nova:creationTime>2023-11-16 20:03:42</nova:creationTime>
Nov 16 20:03:43 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 20:03:43 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 20:03:43 user nova-compute[86931]:       </nova:flavor>
Nov 16 20:03:43 user nova-compute[86931]:       <nova:owner>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:user uuid="fbf47ae1fe0d48bd894864c3548d2cec">tempest-TestShelveInstance-1780029753-project-member</nova:user>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:project uuid="f7457e2e1c5042d4afef7443cf7623c0">tempest-TestShelveInstance-1780029753</nova:project>
Nov 16 20:03:43 user nova-compute[86931]:       </nova:owner>
Nov 16 20:03:43 user nova-compute[86931]:       <nova:ports>
Nov 16 20:03:43 user nova-compute[86931]:         <nova:port uuid="0721a250-fcec-4ac7-83a8-0da893a285a9">
Nov 16 20:03:43 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 20:03:43 user nova-compute[86931]:         </nova:port>
Nov 16 20:03:43 user nova-compute[86931]:       </nova:ports>
Nov 16 20:03:43 user nova-compute[86931]:     </nova:instance>
Nov 16 20:03:43 user nova-compute[86931]:   </metadata>
Nov 16 20:03:43 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 20:03:43 user nova-compute[86931]:     <system>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="serial">42e20686-f534-460c-afa7-f0ee2efefc5d</entry>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="uuid">42e20686-f534-460c-afa7-f0ee2efefc5d</entry>
Nov 16 20:03:43 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 20:03:43 user nova-compute[86931]:     </system>
Nov 16 20:03:43 user nova-compute[86931]:   </sysinfo>
Nov 16 20:03:43 user nova-compute[86931]:   <os>
Nov 16 20:03:43 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 20:03:43 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 20:03:43 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 20:03:43 user nova-compute[86931]:   </os>
Nov 16 20:03:43 user nova-compute[86931]:   <features>
Nov 16 20:03:43 user nova-compute[86931]:     <acpi/>
Nov 16 20:03:43 user nova-compute[86931]:     <apic/>
Nov 16 20:03:43 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 20:03:43 user nova-compute[86931]:   </features>
Nov 16 20:03:43 user nova-compute[86931]:   <clock offset="utc">
Nov 16 20:03:43 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 20:03:43 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 20:03:43 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 20:03:43 user nova-compute[86931]:   </clock>
Nov 16 20:03:43 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 20:03:43 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 20:03:43 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 20:03:43 user nova-compute[86931]:   </cpu>
Nov 16 20:03:43 user nova-compute[86931]:   <devices>
Nov 16 20:03:43 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 20:03:43 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:03:43 user nova-compute[86931]:       <source dev="/dev/sdb"/>
Nov 16 20:03:43 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 20:03:43 user nova-compute[86931]:       <serial>fca6b880-88f3-4e0a-b45b-9087da532c24</serial>
Nov 16 20:03:43 user nova-compute[86931]:     </disk>
Nov 16 20:03:43 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 20:03:43 user nova-compute[86931]:       <mac address="fa:16:3e:8a:1f:cf"/>
Nov 16 20:03:43 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:03:43 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 20:03:43 user nova-compute[86931]:       <target dev="tap0721a250-fc"/>
Nov 16 20:03:43 user nova-compute[86931]:     </interface>
Nov 16 20:03:43 user nova-compute[86931]:     <serial type="pty">
Nov 16 20:03:43 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d/console.log" append="off"/>
Nov 16 20:03:43 user nova-compute[86931]:     </serial>
Nov 16 20:03:43 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 20:03:43 user nova-compute[86931]:     <video>
Nov 16 20:03:43 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:03:43 user nova-compute[86931]:     </video>
Nov 16 20:03:43 user nova-compute[86931]:     <rng model="virtio">
Nov 16 20:03:43 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 20:03:43 user nova-compute[86931]:     </rng>
Nov 16 20:03:43 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 20:03:43 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 20:03:43 user nova-compute[86931]:       <stats period="10"/>
Nov 16 20:03:43 user nova-compute[86931]:     </memballoon>
Nov 16 20:03:43 user nova-compute[86931]:   </devices>
Nov 16 20:03:43 user nova-compute[86931]: </domain>
Nov 16 20:03:43 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuOiKKGZH73nhWeGKaryNwBvydFyynQmMVIOBeVKuA/HJVOPCIT8Jsya3Tk8fM3F8dW4eKVmeNMXKbOgrkjBVHsrZSL+O/sdcY4XpL570k8AzyLSKTnVHp2v2eNN/9UGA==',key_name='tempest-TestShelveInstance-439392724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:03:37Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG os_vif [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e638b23-2440-5114-8fc3-4bcba68b5759', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0721a250-fc, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0721a250-fc, col_values=(('qos', UUID('f9bae8c9-75ea-417e-a333-10bdc97cae69')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0721a250-fc, col_values=(('external_ids', {'iface-id': '0721a250-fcec-4ac7-83a8-0da893a285a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:1f:cf', 'vm-uuid': '42e20686-f534-460c-afa7-f0ee2efefc5d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:43 user nova-compute[86931]: INFO os_vif [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc')
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:03:43 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] No VIF found with MAC fa:16:3e:8a:1f:cf, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:03:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG nova.compute.manager [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:03:45 user nova-compute[86931]: WARNING nova.compute.manager [req-69e66530-17b4-4789-b1c5-aff4ddf00f42 req-efcba08a-5594-4566-b3f5-c65fbec121aa service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state building and task_state spawning.
Nov 16 20:03:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 20:03:47 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance spawned successfully.
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:03:47 user nova-compute[86931]: INFO nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG nova.compute.manager [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:03:47 user nova-compute[86931]: WARNING nova.compute.manager [req-2faa94e4-1e0c-420b-a285-80ab1fb69abd req-427eb755-6052-4b8b-8c9e-1a0d7c4f47ba service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state building and task_state spawning.
Nov 16 20:03:47 user nova-compute[86931]: INFO nova.compute.manager [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Took 10.75 seconds to build instance.
Nov 16 20:03:47 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-270f02a9-1c92-4f37-9444-441e6ca2a028 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.845s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:03:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:03:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:09 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:04:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:04:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 20:04:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:04:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=25.10773468017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 42e20686-f534-460c-afa7-f0ee2efefc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:04:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:04:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:04:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:33 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:38 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:04:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:04:48 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:04:58 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:03 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:08 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:11 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:14 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:05:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:05:19 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:05:19 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:05:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:05:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:05:20 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 20:05:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:05:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.10721206665039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 42e20686-f534-460c-afa7-f0ee2efefc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:05:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:05:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:05:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing instance network info cache due to event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated VIF entry in instance network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:28 user nova-compute[86931]: INFO nova.compute.manager [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Shelve offloading
Nov 16 20:05:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-656e34ab-1a1d-4931-9e8b-0c76b01cbfdd req-b7f169a6-4f5b-400a-861b-fb3aba2db478 service nova] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:05:28 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG nova.compute.manager [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:05:29 user nova-compute[86931]: WARNING nova.compute.manager [req-65c6bb4b-ecfc-48ee-85aa-dc4107c3ca77 req-2daa3aab-3026-4b71-bb7b-109362e26b8a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state active and task_state shelving.
Nov 16 20:05:29 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance destroyed successfully.
Nov 16 20:05:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG nova.network.neutron [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:05:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:05:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance destroyed successfully.
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'resources' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuOiKKGZH73nhWeGKaryNwBvydFyynQmMVIOBeVKuA/HJVOPCIT8Jsya3Tk8fM3F8dW4eKVmeNMXKbOgrkjBVHsrZSL+O/sdcY4XpL570k8AzyLSKTnVHp2v2eNN/9UGA==',key_name='tempest-TestShelveInstance-439392724',keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:03:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:03:47Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_vif [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0721a250-fc, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9bae8c9-75ea-417e-a333-10bdc97cae69) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:05:30 user nova-compute[86931]: INFO os_vif [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc')
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:05:30 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6667d8-6950-416e-87bf-355f5566f7da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:05:30 user nova-compute[86931]: No targets found.
Nov 16 20:05:30 user nova-compute[86931]: iSNS:
Nov 16 20:05:30 user nova-compute[86931]: No targets found.
Nov 16 20:05:30 user nova-compute[86931]: STATIC:
Nov 16 20:05:30 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24
Nov 16 20:05:30 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:05:30 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:05:30 user nova-compute[86931]: FIRMWARE:
Nov 16 20:05:30 user nova-compute[86931]: No targets found.
Nov 16 20:05:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:05:30 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:05:30 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eada076b-c7a6-48cc-ba88-bb2bd0167940]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.compute.manager [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing instance network info cache due to event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.network.neutron [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e6862-c66e-4bc0-b88a-e155b274b033]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:05:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:05:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c4764d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c478e89-8332-410b-9b7f-e685072466fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44379835-fae2-468b-97ec-7d035a884dc0]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fb4ac-4230-46ac-a792-ce65a1285bbe]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[44534997-7cfb-4363-ac0f-79913334ff62]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48c167-7736-454d-9fa9-fa3ebaac4d6b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b45300f-f2e4-4fb5-aa30-8f34dee90c10]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]
Nov 16 20:05:30 user nova-compute[86931]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.
Nov 16 20:05:30 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578264e-b0c4-42e1-9ac5-58668cd5476b]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== disconnect_volume: return (311ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:05:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deleting instance files /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d_del
Nov 16 20:05:30 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deletion of /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d_del complete
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.network.neutron [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated VIF entry in instance network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG nova.network.neutron [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": null, "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0721a250-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:05:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-eba70843-9e82-47b8-b39a-6f8d46c2a7c8 req-297b1ccb-be23-4a1d-bba5-0afe91e364bc service nova] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:05:31 user nova-compute[86931]: WARNING nova.compute.manager [req-c1e018ad-4a63-4d69-b25c-7f9fcb8ad2fe req-ce3ec987-4ace-4216-abe0-3a502fc4223a service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state active and task_state shelving.
Nov 16 20:05:31 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Deleted allocations for instance 42e20686-f534-460c-afa7-f0ee2efefc5d
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.objects.instance [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'numa_topology' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.objects.base [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Object Instance<42e20686-f534-460c-afa7-f0ee2efefc5d> lazy-loaded attributes: resources,numa_topology {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-cda659ba-4836-4554-8a26-7e57d3a66b33 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.161s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:05:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:05:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:13 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:06:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:06:18 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:06:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:06:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:06:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:06:21 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.106353759765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:06:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:06:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:06:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:27 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:06:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:06:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:15 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:16 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:19 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:07:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:07:19 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:20 user nova-compute[86931]: INFO nova.compute.manager [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Unshelving
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:20 user nova-compute[86931]: INFO nova.virt.block_device [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Booting with volume fca6b880-88f3-4e0a-b45b-9087da532c24 at /dev/vda
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG os_brick.utils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:07:20 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:07:20 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=25.105731964111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e463a24-45f6-49dd-9cd5-8590baa5a9e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb884220-936c-4ca7-9466-9f4db964d27c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[82674342-8ab8-4699-9d24-f142a31af21d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd684bc-3bd1-4ee4-a75f-b0dc7ff39a15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 42e20686-f534-460c-afa7-f0ee2efefc5d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:07:21 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443b9c8-3cf5-4456-ac76-d6d35de5ae24]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG os_brick.utils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating existing volume attachment record: ab398b09-e1c9-440a-9793-81e9c911c31c {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:07:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:07:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'pci_requests' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'numa_topology' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 20:07:27 user nova-compute[86931]: INFO nova.compute.claims [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Claim successful on node user
Nov 16 20:07:27 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:27 user nova-compute[86931]: INFO nova.network.neutron [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating port 0721a250-fcec-4ac7-83a8-0da893a285a9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 20:07:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.network.neutron [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.compute.manager [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing instance network info cache due to event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.network.neutron [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 20:07:28 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Creating image(s)
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Did not create local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Ensure instance console log exists: /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start _get_guest_xml network_info=[{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'ab398b09-e1c9-440a-9793-81e9c911c31c', 'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42e20686-f534-460c-afa7-f0ee2efefc5d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fca6b880-88f3-4e0a-b45b-9087da532c24', 'serial': 'fca6b880-88f3-4e0a-b45b-9087da532c24'}, 'boot_index': 0, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.network.neutron [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:07:28 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:07:28 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.objects.instance [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.objects.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Object Instance<42e20686-f534-460c-afa7-f0ee2efefc5d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:07:28 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:07:28 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:07:28 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa32535-6374-4276-8539-13414dd1cb3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:07:28 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e12207-9175-4979-a71a-caaa74058341]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24] added
Nov 16 20:07:28 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f122e60b-71e0-4ac6-9af8-4214ef5c87a7]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c3c5e1-22b3-4620-8361-56d7f0538378]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUWPOLJm {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUWPOLJm" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894d490-949a-4e28-9e64-a7542b3e1da0]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUWPOLJm'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.095s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e1abaa-819c-4b08-86fa-0d80bf2e8a38]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b627a1-9fd8-442c-a1d8-d7b9fa223990]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:07:29 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:07:29 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:07:29 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:07:29 user nova-compute[86931]: 
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fcea79-03dc-41ab-bef7-a083a316de9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]
Nov 16 20:07:29 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.
Nov 16 20:07:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG nova.network.neutron [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated VIF entry in instance network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG nova.network.neutron [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b38e3a-e97d-4670-82fa-3b342a2c64da]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-546cd3c8-f528-415f-9c9a-c89cb5ba2016 req-046bdf2a-2a6e-41fa-8d86-af5517b5897e service nova] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fbffc6-f928-4e12-af3a-aaf86a316f58]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:07:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:07:29 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4802665b-c58d-40a9-a278-f6fbdffbba69]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:07:29 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23337306130666138', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337306130666138', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-439392724',keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:03:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:07:21Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.objects.base [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Object Instance<42e20686-f534-460c-afa7-f0ee2efefc5d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=86931) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 20:07:30 user nova-compute[86931]:   <uuid>42e20686-f534-460c-afa7-f0ee2efefc5d</uuid>
Nov 16 20:07:30 user nova-compute[86931]:   <name>instance-00000034</name>
Nov 16 20:07:30 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 20:07:30 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 20:07:30 user nova-compute[86931]:   <metadata>
Nov 16 20:07:30 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 20:07:30 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 20:07:30 user nova-compute[86931]:       <nova:name>tempest-TestShelveInstance-server-992236114</nova:name>
Nov 16 20:07:30 user nova-compute[86931]:       <nova:creationTime>2023-11-16 20:07:28</nova:creationTime>
Nov 16 20:07:30 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 20:07:30 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 20:07:30 user nova-compute[86931]:       </nova:flavor>
Nov 16 20:07:30 user nova-compute[86931]:       <nova:owner>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:user uuid="fbf47ae1fe0d48bd894864c3548d2cec">tempest-TestShelveInstance-1780029753-project-member</nova:user>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:project uuid="f7457e2e1c5042d4afef7443cf7623c0">tempest-TestShelveInstance-1780029753</nova:project>
Nov 16 20:07:30 user nova-compute[86931]:       </nova:owner>
Nov 16 20:07:30 user nova-compute[86931]:       <nova:ports>
Nov 16 20:07:30 user nova-compute[86931]:         <nova:port uuid="0721a250-fcec-4ac7-83a8-0da893a285a9">
Nov 16 20:07:30 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 20:07:30 user nova-compute[86931]:         </nova:port>
Nov 16 20:07:30 user nova-compute[86931]:       </nova:ports>
Nov 16 20:07:30 user nova-compute[86931]:     </nova:instance>
Nov 16 20:07:30 user nova-compute[86931]:   </metadata>
Nov 16 20:07:30 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 20:07:30 user nova-compute[86931]:     <system>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="serial">42e20686-f534-460c-afa7-f0ee2efefc5d</entry>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="uuid">42e20686-f534-460c-afa7-f0ee2efefc5d</entry>
Nov 16 20:07:30 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 20:07:30 user nova-compute[86931]:     </system>
Nov 16 20:07:30 user nova-compute[86931]:   </sysinfo>
Nov 16 20:07:30 user nova-compute[86931]:   <os>
Nov 16 20:07:30 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 20:07:30 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 20:07:30 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 20:07:30 user nova-compute[86931]:   </os>
Nov 16 20:07:30 user nova-compute[86931]:   <features>
Nov 16 20:07:30 user nova-compute[86931]:     <acpi/>
Nov 16 20:07:30 user nova-compute[86931]:     <apic/>
Nov 16 20:07:30 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 20:07:30 user nova-compute[86931]:   </features>
Nov 16 20:07:30 user nova-compute[86931]:   <clock offset="utc">
Nov 16 20:07:30 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 20:07:30 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 20:07:30 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 20:07:30 user nova-compute[86931]:   </clock>
Nov 16 20:07:30 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 20:07:30 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 20:07:30 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 20:07:30 user nova-compute[86931]:   </cpu>
Nov 16 20:07:30 user nova-compute[86931]:   <devices>
Nov 16 20:07:30 user nova-compute[86931]:     <disk type="block" device="disk">
Nov 16 20:07:30 user nova-compute[86931]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:07:30 user nova-compute[86931]:       <source dev="/dev/sdb"/>
Nov 16 20:07:30 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 20:07:30 user nova-compute[86931]:       <serial>fca6b880-88f3-4e0a-b45b-9087da532c24</serial>
Nov 16 20:07:30 user nova-compute[86931]:     </disk>
Nov 16 20:07:30 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 20:07:30 user nova-compute[86931]:       <mac address="fa:16:3e:8a:1f:cf"/>
Nov 16 20:07:30 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:07:30 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 20:07:30 user nova-compute[86931]:       <target dev="tap0721a250-fc"/>
Nov 16 20:07:30 user nova-compute[86931]:     </interface>
Nov 16 20:07:30 user nova-compute[86931]:     <serial type="pty">
Nov 16 20:07:30 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d/console.log" append="off"/>
Nov 16 20:07:30 user nova-compute[86931]:     </serial>
Nov 16 20:07:30 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 20:07:30 user nova-compute[86931]:     <video>
Nov 16 20:07:30 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:07:30 user nova-compute[86931]:     </video>
Nov 16 20:07:30 user nova-compute[86931]:     <rng model="virtio">
Nov 16 20:07:30 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 20:07:30 user nova-compute[86931]:     </rng>
Nov 16 20:07:30 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 20:07:30 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 20:07:30 user nova-compute[86931]:       <stats period="10"/>
Nov 16 20:07:30 user nova-compute[86931]:     </memballoon>
Nov 16 20:07:30 user nova-compute[86931]:   </devices>
Nov 16 20:07:30 user nova-compute[86931]: </domain>
Nov 16 20:07:30 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-439392724',keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:03:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:07:21Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG os_vif [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e638b23-2440-5114-8fc3-4bcba68b5759', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0721a250-fc, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0721a250-fc, col_values=(('qos', UUID('16bc7791-6ae7-417c-96bd-74f97a6088e2')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0721a250-fc, col_values=(('external_ids', {'iface-id': '0721a250-fcec-4ac7-83a8-0da893a285a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:1f:cf', 'vm-uuid': '42e20686-f534-460c-afa7-f0ee2efefc5d'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:30 user nova-compute[86931]: INFO os_vif [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc')
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:07:30 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] No VIF found with MAC fa:16:3e:8a:1f:cf, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:31 user nova-compute[86931]: DEBUG nova.compute.manager [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:07:31 user nova-compute[86931]: WARNING nova.compute.manager [req-55b3325f-fd6d-4e71-9b93-0c0ef7916b23 req-9fac9860-44bd-4223-bed0-b56b90848908 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 20:07:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 20:07:33 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance spawned successfully.
Nov 16 20:07:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-bc2f169f-477b-4473-b404-3b3861c15412 tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.236s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:07:33 user nova-compute[86931]: DEBUG nova.compute.manager [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:07:33 user nova-compute[86931]: WARNING nova.compute.manager [req-40e19120-c146-412f-871a-09746e781038 req-f9fa7aef-9a80-432a-a8a6-1c16ad550440 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state active and task_state None.
Nov 16 20:07:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:07:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:07:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:15 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:17 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:08:20 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:08:21 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=86931) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 20:08:22 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:08:22 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.10425567626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance 42e20686-f534-460c-afa7-f0ee2efefc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:08:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:08:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:25 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:29 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:29 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:30 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:35 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:40 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:08:42 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:42 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Triggering sync for uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 20:08:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:08:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:08:42 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:08:45 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:50 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 20:08:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:00 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing instance network info cache due to event network-changed-0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] Acquiring lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] Acquired lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Refreshing network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:11 user nova-compute[86931]: INFO nova.compute.manager [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Terminating instance
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.compute.manager [req-8950deb9-dadd-40a1-9b7c-fc59be2145dc req-4ec34f70-37f3-4051-ab8d-6f477777766f service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-unplugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updated VIF entry in instance network info cache for port 0721a250-fcec-4ac7-83a8-0da893a285a9. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG nova.network.neutron [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [{"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:09:11 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-c0a6389a-9857-4a7d-980b-278d529bd7c8 req-1e3729b9-403e-4d50-bb6a-8ace473c97e7 service nova] Releasing lock "refresh_cache-42e20686-f534-460c-afa7-f0ee2efefc5d" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:09:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Instance destroyed successfully.
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.objects.instance [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lazy-loading 'resources' on Instance uuid 42e20686-f534-460c-afa7-f0ee2efefc5d {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T20:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-992236114',display_name='tempest-TestShelveInstance-server-992236114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-992236114',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuOiKKGZH73nhWeGKaryNwBvydFyynQmMVIOBeVKuA/HJVOPCIT8Jsya3Tk8fM3F8dW4eKVmeNMXKbOgrkjBVHsrZSL+O/sdcY4XpL570k8AzyLSKTnVHp2v2eNN/9UGA==',key_name='tempest-TestShelveInstance-439392724',keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7457e2e1c5042d4afef7443cf7623c0',ramdisk_id='',reservation_id='r-bk5vy1wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1780029753',owner_user_name='tempest-TestShelveInstance-1780029753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:07:34Z,user_data=None,user_id='fbf47ae1fe0d48bd894864c3548d2cec',uuid=42e20686-f534-460c-afa7-f0ee2efefc5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converting VIF {"id": "0721a250-fcec-4ac7-83a8-0da893a285a9", "address": "fa:16:3e:8a:1f:cf", "network": {"id": "30e6a322-a217-455f-ad5b-a6dd0a887dba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1396078083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7457e2e1c5042d4afef7443cf7623c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0721a250-fc", "ovs_interfaceid": "0721a250-fcec-4ac7-83a8-0da893a285a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_vif [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0721a250-fc, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16bc7791-6ae7-417c-96bd-74f97a6088e2) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:12 user nova-compute[86931]: INFO os_vif [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:1f:cf,bridge_name='br-int',has_traffic_filtering=True,id=0721a250-fcec-4ac7-83a8-0da893a285a9,network=Network(30e6a322-a217-455f-ad5b-a6dd0a887dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0721a250-fc')
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUWPOLJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:09:12 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4822f89-ed77-4abd-9cfe-3ae928825711]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:09:12 user nova-compute[86931]: No targets found.
Nov 16 20:09:12 user nova-compute[86931]: iSNS:
Nov 16 20:09:12 user nova-compute[86931]: No targets found.
Nov 16 20:09:12 user nova-compute[86931]: STATIC:
Nov 16 20:09:12 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24
Nov 16 20:09:12 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:09:12 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:09:12 user nova-compute[86931]: FIRMWARE:
Nov 16 20:09:12 user nova-compute[86931]: No targets found.
Nov 16 20:09:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:09:12 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:09:12 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659c339-da43-4ec3-9ea0-fa2fbbd78471]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480b9a4-592e-4aeb-9189-94ceb3a9c698]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:09:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 (non-flash)
Nov 16 20:09:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c61e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b45aec-f32d-4808-8475-137c4d4f2c8d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5090c9-1399-4d10-bdb6-7e1dcbdfcfd4]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e36bf-d351-47fd-8447-714e6c253112]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bfe594-8dc7-49b0-ad24-124eb427238d]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ec2b55-3dc2-4f46-8b6c-6126df40c4a9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c78dd4-7cf1-465b-9502-114a735b1ba5]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260]
Nov 16 20:09:12 user nova-compute[86931]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24, portal: 172.16.0.220,3260] successful.
Nov 16 20:09:12 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fca6b880-88f3-4e0a-b45b-9087da532c24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b81fe9-5987-45a0-9777-c379c9be679a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] <== disconnect_volume: return (313ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:09:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deleting instance files /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d_del
Nov 16 20:09:12 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deletion of /opt/stack/data/nova/instances/42e20686-f534-460c-afa7-f0ee2efefc5d_del complete
Nov 16 20:09:12 user nova-compute[86931]: INFO nova.compute.manager [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 16 20:09:12 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:12 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:09:12 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Took 0.37 seconds to deallocate network for instance.
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-b4a230e1-7e10-4970-9d78-c835982e8219 req-9a314c6b-2b3c-4101-8653-e627f25c2cde service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-deleted-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:09:13 user nova-compute[86931]: INFO nova.compute.manager [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Took 0.70 seconds to detach 1 volumes for instance.
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Deleting volume: fca6b880-88f3-4e0a-b45b-9087da532c24 {{(pid=86931) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] Acquiring lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] No waiting events found dispatching network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:09:13 user nova-compute[86931]: WARNING nova.compute.manager [req-66f9abc0-d288-4d3c-89e5-0d276c51ed6e req-77771975-0c32-4570-8396-d21a1db83e75 service nova] [instance: 42e20686-f534-460c-afa7-f0ee2efefc5d] Received unexpected event network-vif-plugged-0721a250-fcec-4ac7-83a8-0da893a285a9 for instance with vm_state active and task_state deleting.
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:09:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:13 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Deleted allocations for instance 42e20686-f534-460c-afa7-f0ee2efefc5d
Nov 16 20:09:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-78f60895-34c8-48ff-a6f7-0819a0964d1a tempest-TestShelveInstance-1780029753 tempest-TestShelveInstance-1780029753-project-member] Lock "42e20686-f534-460c-afa7-f0ee2efefc5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:18 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:09:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:09:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:09:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:21 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:09:22 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:09:22 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.103458404541016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:09:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:09:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:09:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:09:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:09:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:05 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:10:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:10:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:10:23 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:10:23 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9253MB free_disk=25.111011505126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:10:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:26 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:10:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:10:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:41 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:43 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Starting instance... {{(pid=86931) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=86931) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 20:10:49 user nova-compute[86931]: INFO nova.compute.claims [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Claim successful on node user
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Start building networks asynchronously for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Allocating IP information in the background. {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] allocate_for_instance() {{(pid=86931) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 20:10:49 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Start building block device mappings for instance. {{(pid=86931) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 20:10:49 user nova-compute[86931]: DEBUG nova.policy [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa9c7ecf8eb84d808d4106c38e4dae49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68c67df0d4d24e9b90ad811fca07b265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86931) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Start spawning the instance on the hypervisor. {{(pid=86931) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Creating instance directory {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 20:10:50 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Creating image(s)
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "/opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "/opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "/opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.214s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.192s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk 1073741824 {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93,backing_fmt=raw /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk 1073741824" returned: 0 in 0.058s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "b75a4bc4c7b3b292e087b5300496870d9005ec93" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b75a4bc4c7b3b292e087b5300496870d9005ec93 --force-share --output=json" returned: 0 in 0.216s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk. size=1073741824 {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:10:50 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Successfully created port: a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.disk.api [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Cannot resize image /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk to a smaller size. {{(pid=86931) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Created local disks {{(pid=86931) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Ensure instance console log exists: /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/console.log {{(pid=86931) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Successfully updated port: a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Building network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Instance cache missing network info. {{(pid=86931) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-changed-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.compute.manager [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Refreshing instance network info cache due to event network-changed-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.network.neutron [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Instance network_info: |[{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=86931) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.network.neutron [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Refreshing network info cache for port a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Start _get_guest_xml network_info=[{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '04ef6bdb-1977-4f57-a0fb-6742ffba000b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 20:10:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:10:51 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CPU controller missing on host. {{(pid=86931) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.host [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CPU controller found on host. {{(pid=86931) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=86931) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T19:17:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T19:18:00Z,direct_url=<?>,disk_format='qcow2',id=04ef6bdb-1977-4f57-a0fb-6742ffba000b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='94855b19cd954f58abafb7a3a4fe23aa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T19:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flavor limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Image limits 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flavor pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Image pref 0:0:0 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=86931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Got 1 possible topologies {{(pid=86931) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 20:10:51 user nova-compute[86931]: DEBUG nova.virt.hardware [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=86931) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-929124677',display_name='tempest-SnapshotDataIntegrityTests-server-929124677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-929124677',id=53,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFperLsdirIdjpbuVEFeojNPYJAeCpta3zis+be3MaY8FrvZtRHkmDrglugSPEkmrzhi6j09IMPrHteLz1LhevCwZeywwyRzsk8u3bN+leSNFcup2ZSdrdADHSrL8IFtg==',key_name='tempest-keypair-1734009199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c67df0d4d24e9b90ad811fca07b265',ramdisk_id='',reservation_id='r-0m5op5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1284849085',owner_user_name='tempest-SnapshotDataIntegrityTests-1284849085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa9c7ecf8eb84d808d4106c38e4dae49',uuid=cde7ab0e-ce1d-4b18-81e0-eef883b9b054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=86931) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converting VIF {"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.objects.instance [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'pci_devices' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] End _get_guest_xml xml=<domain type="kvm">
Nov 16 20:10:52 user nova-compute[86931]:   <uuid>cde7ab0e-ce1d-4b18-81e0-eef883b9b054</uuid>
Nov 16 20:10:52 user nova-compute[86931]:   <name>instance-00000035</name>
Nov 16 20:10:52 user nova-compute[86931]:   <memory>524288</memory>
Nov 16 20:10:52 user nova-compute[86931]:   <vcpu>1</vcpu>
Nov 16 20:10:52 user nova-compute[86931]:   <metadata>
Nov 16 20:10:52 user nova-compute[86931]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 20:10:52 user nova-compute[86931]:       <nova:package version="0.0.0"/>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-929124677</nova:name>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:creationTime>2023-11-16 20:10:51</nova:creationTime>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:flavor name="m1.tiny">
Nov 16 20:10:52 user nova-compute[86931]:         <nova:memory>512</nova:memory>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:disk>1</nova:disk>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:swap>0</nova:swap>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:vcpus>1</nova:vcpus>
Nov 16 20:10:52 user nova-compute[86931]:       </nova:flavor>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:owner>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:user uuid="fa9c7ecf8eb84d808d4106c38e4dae49">tempest-SnapshotDataIntegrityTests-1284849085-project-member</nova:user>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:project uuid="68c67df0d4d24e9b90ad811fca07b265">tempest-SnapshotDataIntegrityTests-1284849085</nova:project>
Nov 16 20:10:52 user nova-compute[86931]:       </nova:owner>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:root type="image" uuid="04ef6bdb-1977-4f57-a0fb-6742ffba000b"/>
Nov 16 20:10:52 user nova-compute[86931]:       <nova:ports>
Nov 16 20:10:52 user nova-compute[86931]:         <nova:port uuid="a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0">
Nov 16 20:10:52 user nova-compute[86931]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 20:10:52 user nova-compute[86931]:         </nova:port>
Nov 16 20:10:52 user nova-compute[86931]:       </nova:ports>
Nov 16 20:10:52 user nova-compute[86931]:     </nova:instance>
Nov 16 20:10:52 user nova-compute[86931]:   </metadata>
Nov 16 20:10:52 user nova-compute[86931]:   <sysinfo type="smbios">
Nov 16 20:10:52 user nova-compute[86931]:     <system>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="product">OpenStack Nova</entry>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="version">0.0.0</entry>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="serial">cde7ab0e-ce1d-4b18-81e0-eef883b9b054</entry>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="uuid">cde7ab0e-ce1d-4b18-81e0-eef883b9b054</entry>
Nov 16 20:10:52 user nova-compute[86931]:       <entry name="family">Virtual Machine</entry>
Nov 16 20:10:52 user nova-compute[86931]:     </system>
Nov 16 20:10:52 user nova-compute[86931]:   </sysinfo>
Nov 16 20:10:52 user nova-compute[86931]:   <os>
Nov 16 20:10:52 user nova-compute[86931]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 20:10:52 user nova-compute[86931]:     <boot dev="hd"/>
Nov 16 20:10:52 user nova-compute[86931]:     <smbios mode="sysinfo"/>
Nov 16 20:10:52 user nova-compute[86931]:   </os>
Nov 16 20:10:52 user nova-compute[86931]:   <features>
Nov 16 20:10:52 user nova-compute[86931]:     <acpi/>
Nov 16 20:10:52 user nova-compute[86931]:     <apic/>
Nov 16 20:10:52 user nova-compute[86931]:     <vmcoreinfo/>
Nov 16 20:10:52 user nova-compute[86931]:   </features>
Nov 16 20:10:52 user nova-compute[86931]:   <clock offset="utc">
Nov 16 20:10:52 user nova-compute[86931]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 20:10:52 user nova-compute[86931]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 20:10:52 user nova-compute[86931]:     <timer name="hpet" present="no"/>
Nov 16 20:10:52 user nova-compute[86931]:   </clock>
Nov 16 20:10:52 user nova-compute[86931]:   <cpu mode="custom" match="exact">
Nov 16 20:10:52 user nova-compute[86931]:     <model>Nehalem</model>
Nov 16 20:10:52 user nova-compute[86931]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 20:10:52 user nova-compute[86931]:   </cpu>
Nov 16 20:10:52 user nova-compute[86931]:   <devices>
Nov 16 20:10:52 user nova-compute[86931]:     <disk type="file" device="disk">
Nov 16 20:10:52 user nova-compute[86931]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 20:10:52 user nova-compute[86931]:       <source file="/opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk"/>
Nov 16 20:10:52 user nova-compute[86931]:       <target dev="vda" bus="virtio"/>
Nov 16 20:10:52 user nova-compute[86931]:     </disk>
Nov 16 20:10:52 user nova-compute[86931]:     <interface type="ethernet">
Nov 16 20:10:52 user nova-compute[86931]:       <mac address="fa:16:3e:93:b2:5a"/>
Nov 16 20:10:52 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:10:52 user nova-compute[86931]:       <mtu size="1442"/>
Nov 16 20:10:52 user nova-compute[86931]:       <target dev="tapa13ee2cf-e5"/>
Nov 16 20:10:52 user nova-compute[86931]:     </interface>
Nov 16 20:10:52 user nova-compute[86931]:     <serial type="pty">
Nov 16 20:10:52 user nova-compute[86931]:       <log file="/opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/console.log" append="off"/>
Nov 16 20:10:52 user nova-compute[86931]:     </serial>
Nov 16 20:10:52 user nova-compute[86931]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 20:10:52 user nova-compute[86931]:     <video>
Nov 16 20:10:52 user nova-compute[86931]:       <model type="virtio"/>
Nov 16 20:10:52 user nova-compute[86931]:     </video>
Nov 16 20:10:52 user nova-compute[86931]:     <rng model="virtio">
Nov 16 20:10:52 user nova-compute[86931]:       <backend model="random">/dev/urandom</backend>
Nov 16 20:10:52 user nova-compute[86931]:     </rng>
Nov 16 20:10:52 user nova-compute[86931]:     <controller type="usb" index="0" model="none"/>
Nov 16 20:10:52 user nova-compute[86931]:     <memballoon model="virtio">
Nov 16 20:10:52 user nova-compute[86931]:       <stats period="10"/>
Nov 16 20:10:52 user nova-compute[86931]:     </memballoon>
Nov 16 20:10:52 user nova-compute[86931]:   </devices>
Nov 16 20:10:52 user nova-compute[86931]: </domain>
Nov 16 20:10:52 user nova-compute[86931]:  {{(pid=86931) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-929124677',display_name='tempest-SnapshotDataIntegrityTests-server-929124677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-929124677',id=53,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFperLsdirIdjpbuVEFeojNPYJAeCpta3zis+be3MaY8FrvZtRHkmDrglugSPEkmrzhi6j09IMPrHteLz1LhevCwZeywwyRzsk8u3bN+leSNFcup2ZSdrdADHSrL8IFtg==',key_name='tempest-keypair-1734009199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68c67df0d4d24e9b90ad811fca07b265',ramdisk_id='',reservation_id='r-0m5op5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1284849085',owner_user_name='tempest-SnapshotDataIntegrityTests-1284849085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T20:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa9c7ecf8eb84d808d4106c38e4dae49',uuid=cde7ab0e-ce1d-4b18-81e0-eef883b9b054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converting VIF {"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG os_vif [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5') {{(pid=86931) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8530fc90-b3b1-53e4-8779-972ddcea43a3', '_type': 'linux-noop'}}, row=False) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa13ee2cf-e5, may_exist=True, interface_attrs={}) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa13ee2cf-e5, col_values=(('qos', UUID('8c164555-1788-4192-896c-c0febc688936')),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa13ee2cf-e5, col_values=(('external_ids', {'iface-id': 'a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:b2:5a', 'vm-uuid': 'cde7ab0e-ce1d-4b18-81e0-eef883b9b054'}),), if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:52 user nova-compute[86931]: INFO os_vif [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5')
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No VIF found with MAC fa:16:3e:93:b2:5a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated VIF entry in instance network info cache for port a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG nova.network.neutron [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-3d46afb3-001d-4c54-ac30-ba8fa4b62374 req-361a925a-c341-401e-a9ae-bca6b13b7638 service nova] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:10:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:53 user nova-compute[86931]: DEBUG nova.compute.manager [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] No waiting events found dispatching network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:10:53 user nova-compute[86931]: WARNING nova.compute.manager [req-5ecc9fac-402e-42dc-8449-d9dde0315e6a req-105f2d64-ef13-4144-8331-1be14562acdf service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received unexpected event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 for instance with vm_state building and task_state spawning.
Nov 16 20:10:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Instance event wait completed in 0 seconds for  {{(pid=86931) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Guest created on hypervisor {{(pid=86931) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 20:10:55 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Instance spawned successfully.
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_cdrom_bus of ide {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_disk_bus of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_input_bus of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_pointer_model of None {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_video_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:55 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Found default for hw_vif_model of virtio {{(pid=86931) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 20:10:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:10:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:10:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:10:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:56 user nova-compute[86931]: DEBUG nova.compute.manager [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] No waiting events found dispatching network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:10:56 user nova-compute[86931]: WARNING nova.compute.manager [req-d1c639db-aa99-4252-a191-6f36287d20e5 req-5b1294d5-7f55-4566-92c1-41f06006e845 service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received unexpected event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 for instance with vm_state building and task_state spawning.
Nov 16 20:10:56 user nova-compute[86931]: INFO nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 16 20:10:56 user nova-compute[86931]: DEBUG nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Checking state {{(pid=86931) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 20:10:56 user nova-compute[86931]: INFO nova.compute.manager [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Took 6.63 seconds to build instance.
Nov 16 20:10:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-af10a399-5717-4463-84cc-15cdea772fe9 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.732s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:10:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:10:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:20 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:11:21 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:11:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:11:26 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:11:26 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=25.050621032714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:11:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:11:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:28 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:11:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:11:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:11:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:11:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:12:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:12:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:12:23 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:12:24 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:12:24 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:12:24 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:12:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:26 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:12:26 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.04956817626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:12:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:12:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:27 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:29 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:29 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:29 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:12:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:12:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-changed-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:12:40 user nova-compute[86931]: DEBUG nova.compute.manager [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Refreshing instance network info cache due to event network-changed-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0. {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 20:12:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:12:40 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:12:40 user nova-compute[86931]: DEBUG nova.network.neutron [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Refreshing network info cache for port a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 20:12:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated VIF entry in instance network info cache for port a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0. {{(pid=86931) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 20:12:41 user nova-compute[86931]: DEBUG nova.network.neutron [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:12:41 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-11e71e67-e6b7-440a-be6d-ce1196863c10 req-f1903c10-33b9-417b-b73b-b00552fed90c service nova] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:12:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:12:44 user nova-compute[86931]: INFO nova.compute.manager [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attaching volume b8d5e482-0ef0-4f17-9664-fde6ad466c0b to /dev/vdb
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.utils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[154d9ed6-ee37-452f-83aa-23770965ac2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7933a9-d66c-4fbe-80c1-cadc54b72023]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd70f54-cb94-459f-8a78-656326ebeff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0769b48e-8af1-447e-83b0-a67e9291b794]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:12:44 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:12:44 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a3ffe1-0798-4144-8b77-9b441497791c]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG os_brick.utils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:12:44 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating existing volume attachment record: 5200affe-3b8a-4850-86bf-0c8e390a9ef7 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:12:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axihkHcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:12:49 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:12:49 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:12:49 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e1a55-6d93-47d3-a095-0467ce93fb0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:12:49 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[32585175-ae03-4627-92bc-01a11107b2c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b] added
Nov 16 20:12:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafcfad0-3b78-4c98-9b73-6cd5cde1a385]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaf4ab8-937b-4e41-bf72-878fa336ceef]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axihkHcP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v axihkHcP" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[342e76c7-c01a-4da0-9915-960bb14827f5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'axihkHcP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf1bc8-b100-410a-8d6e-323584ac5d94]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c103ed9-8784-4e92-bfea-d812fc4d4f75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:12:49 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:12:49 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:12:49 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:12:49 user nova-compute[86931]: 
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f7a74-e580-458a-88de-3ae1d300c59e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260]
Nov 16 20:12:49 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260] successful.
Nov 16 20:12:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ab50a-3ce2-4695-ad73-7981dcca3bf1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c03cdaa-ce2f-45c4-a053-a6bb5da4d51c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)
Nov 16 20:12:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)
Nov 16 20:12:49 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb2a4c8-dd22-4ad9-91a9-ffb0f4d7662a]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:12:49 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axihkHcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26537386461613564', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537386461613564', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:12:50 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 20:12:50 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:12:50 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:12:50 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:12:50 user nova-compute[86931]:   <serial>b8d5e482-0ef0-4f17-9664-fde6ad466c0b</serial>
Nov 16 20:12:50 user nova-compute[86931]: </disk>
Nov 16 20:12:50 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 20:12:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:12:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:12:51 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No VIF found with MAC fa:16:3e:93:b2:5a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:12:51 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ef158367-32a7-434e-91ac-6a313ad778e2 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.733s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:12:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:12:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:13:02 user nova-compute[86931]: INFO nova.compute.manager [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Detaching volume b8d5e482-0ef0-4f17-9664-fde6ad466c0b
Nov 16 20:13:02 user nova-compute[86931]: INFO nova.virt.block_device [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attempting to driver detach volume b8d5e482-0ef0-4f17-9664-fde6ad466c0b from mountpoint /dev/vdb
Nov 16 20:13:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Attempting to detach device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:13:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:13:02 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:13:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:13:02 user nova-compute[86931]:   <serial>b8d5e482-0ef0-4f17-9664-fde6ad466c0b</serial>
Nov 16 20:13:02 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:13:02 user nova-compute[86931]: </disk>
Nov 16 20:13:02 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:13:02 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config.
Nov 16 20:13:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:13:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:13:02 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:13:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:13:02 user nova-compute[86931]:   <serial>b8d5e482-0ef0-4f17-9664-fde6ad466c0b</serial>
Nov 16 20:13:02 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:13:02 user nova-compute[86931]: </disk>
Nov 16 20:13:02 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 20:13:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:22 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 is timed out.
Nov 16 20:13:22 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config.
Nov 16 20:13:22 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'axihkHcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:13:22 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23867dbc-baac-4a3a-b9a4-556cb034af9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:13:22 user nova-compute[86931]: No targets found.
Nov 16 20:13:22 user nova-compute[86931]: iSNS:
Nov 16 20:13:22 user nova-compute[86931]: No targets found.
Nov 16 20:13:22 user nova-compute[86931]: STATIC:
Nov 16 20:13:22 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b
Nov 16 20:13:22 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:13:22 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:13:22 user nova-compute[86931]: FIRMWARE:
Nov 16 20:13:22 user nova-compute[86931]: No targets found.
Nov 16 20:13:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:13:22 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:13:22 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d90763d-2072-4462-b821-1e14ec441961]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e7469b-3084-4ffa-a071-306aaff1cb3e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)
Nov 16 20:13:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b (non-flash)
Nov 16 20:13:22 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa5c1c5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[52833816-f105-4940-b109-bd022c849210]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee427766-62a8-45b1-b66c-d6775eaca8d3]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c4f1e4-baf9-4835-9e01-e9999203c638]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec875fe-9126-4f52-af74-6452d44f1094]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[de122947-0f48-4ba9-8163-5b7f593bbb1f]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:22 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca578c-364e-4e9d-8469-86c6fe2ef5dc]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260]
Nov 16 20:13:23 user nova-compute[86931]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b, portal: 172.16.0.220,3260] successful.
Nov 16 20:13:23 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d5e482-0ef0-4f17-9664-fde6ad466c0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e4148-46ee-4d6a-9664-fb1fcfb5c01e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== disconnect_volume: return (297ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG nova.objects.instance [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:13:23 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-870042b4-b47a-4f71-8cb3-0e74c7a05b2a tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.577s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:13:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:13:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.048263549804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:13:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:13:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:13:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:34 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:13:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:45 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:13:45 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=86931) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:13:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG nova.objects.instance [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:13:54 user nova-compute[86931]: INFO nova.compute.manager [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attaching volume a28ed536-fd9d-4fba-9f4c-25bb7e92e832 to /dev/vdb
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca0ae5-c85b-4002-a2b6-928c51fa31ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de458b-fe08-4a9f-a865-7ad91eb88a61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae43f791-84cb-4207-92e3-48389985fa9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436cdbc-ffe5-4744-af7c-691190c223e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:13:54 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:13:54 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[583cb3d2-3e69-48dc-b38e-299e8aefe7d7]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG os_brick.utils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:13:54 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating existing volume attachment record: d8214306-4e16-4461-84f5-f98cc8dc44b0 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:13:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:13:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgHpXUGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:13:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:13:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:13:59 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23add848-9839-4bf4-87e7-6cb6c29f1bfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:13:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3ef263-55da-429d-b10c-413be7fe5583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832] added
Nov 16 20:13:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[23013daf-1cda-46e2-b3a8-0193d0f860eb]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d451f-5efa-4326-bd47-c3a56b282aa9]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgHpXUGa {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgHpXUGa" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[878b226b-c6d8-436d-a59d-295d763bbab6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cgHpXUGa'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b3603d-c694-478a-afca-86a004b99d32]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9299f1b6-6552-43b7-a6dd-9de74b58878c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:13:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:13:59 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:13:59 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:13:59 user nova-compute[86931]: 
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c9861-cdea-41d2-8444-8a025a254bcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260]
Nov 16 20:13:59 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260] successful.
Nov 16 20:13:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0420c7f-d041-42de-9742-efba717b29d1]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e845db-e7bd-4a8d-b470-37f1f603b048]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)
Nov 16 20:13:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)
Nov 16 20:13:59 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456f6f1-ce9a-411e-b6f0-5d4da82305d1]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:13:59 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgHpXUGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23761363162623261', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761363162623261', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG nova.objects.instance [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:14:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 20:14:00 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:14:00 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:14:00 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:14:00 user nova-compute[86931]:   <serial>a28ed536-fd9d-4fba-9f4c-25bb7e92e832</serial>
Nov 16 20:14:00 user nova-compute[86931]: </disk>
Nov 16 20:14:00 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No VIF found with MAC fa:16:3e:93:b2:5a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-fe6a226c-cb0f-4a4d-871e-380e6388ab1e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.615s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Cleaning up deleted instances {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 20:14:01 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] There are 0 instances to clean {{(pid=86931) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 20:14:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:14:03 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:14:03 user nova-compute[86931]: INFO nova.compute.manager [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Detaching volume a28ed536-fd9d-4fba-9f4c-25bb7e92e832
Nov 16 20:14:03 user nova-compute[86931]: INFO nova.virt.block_device [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attempting to driver detach volume a28ed536-fd9d-4fba-9f4c-25bb7e92e832 from mountpoint /dev/vdb
Nov 16 20:14:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Attempting to detach device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 20:14:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:14:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:14:04 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:14:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:14:04 user nova-compute[86931]:   <serial>a28ed536-fd9d-4fba-9f4c-25bb7e92e832</serial>
Nov 16 20:14:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:14:04 user nova-compute[86931]: </disk>
Nov 16 20:14:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:14:04 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config.
Nov 16 20:14:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 20:14:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:14:04 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:14:04 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:14:04 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:14:04 user nova-compute[86931]:   <serial>a28ed536-fd9d-4fba-9f4c-25bb7e92e832</serial>
Nov 16 20:14:04 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:14:04 user nova-compute[86931]: </disk>
Nov 16 20:14:04 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:14:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 20:14:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:24 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 is timed out.
Nov 16 20:14:24 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config.
Nov 16 20:14:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgHpXUGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:14:24 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f01701-152d-4465-b292-e5b1da444eac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:14:24 user nova-compute[86931]: No targets found.
Nov 16 20:14:24 user nova-compute[86931]: iSNS:
Nov 16 20:14:24 user nova-compute[86931]: No targets found.
Nov 16 20:14:24 user nova-compute[86931]: STATIC:
Nov 16 20:14:24 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832
Nov 16 20:14:24 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:14:24 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:14:24 user nova-compute[86931]: FIRMWARE:
Nov 16 20:14:24 user nova-compute[86931]: No targets found.
Nov 16 20:14:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:14:24 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:14:24 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[de63f94a-5f12-481b-a428-edf60fff39b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5908e56e-3808-4d7b-b5d4-8a86e8d2e927]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)
Nov 16 20:14:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 (non-flash)
Nov 16 20:14:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c523eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cafb89e-819b-4a22-b2a2-de5738b2ab83]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab4227d-907f-4fb3-b7ce-c5f0a8bf2109]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6047890c-414b-41cc-a522-3962476cfff5]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56cd46e-22f6-4e23-8d05-be99162a193a]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b135044-a62c-47ef-9a7a-5b2a973f7d1a]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741597b-4586-4321-b0da-00c127ab69d0]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260]
Nov 16 20:14:24 user nova-compute[86931]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832, portal: 172.16.0.220,3260] successful.
Nov 16 20:14:24 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a28ed536-fd9d-4fba-9f4c-25bb7e92e832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d4be08-10b8-4fc8-ac21-5eddff2ec1c8]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== disconnect_volume: return (314ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:14:24 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:14:25 user nova-compute[86931]: DEBUG nova.objects.instance [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:14:25 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-ac5285a5-ed94-4ae6-bfed-3911a9de9ef4 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.606s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:14:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:14:27 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:28 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:14:28 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.047290802001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:14:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:14:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:14:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:14:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:14:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:14:29 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:14:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:14:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:14:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:14:55 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:14:55 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:14:56 user nova-compute[86931]: INFO nova.compute.manager [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attaching volume fcb36b01-6766-4ff0-8e03-dced148be9cc to /dev/vdb
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f23613-b131-492d-9fb0-f17e11a4f70c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5252a-f783-4069-a3a5-22d49bc9625a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d3f572-c1f8-43a1-aad9-607425af678d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac649c-ba48-4797-b1f8-b07314c9172c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:14:56 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:14:56 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f56cc-a7c4-487b-9659-c657878cb669]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG os_brick.utils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:14:56 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating existing volume attachment record: 6e690307-7d81-4b42-85b4-6e0241548720 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:14:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AurcjiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:15:00 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:15:00 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:15:00 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5466b982-560c-41be-a7d2-5e6e415c3171]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:15:00 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75200e-129d-4242-a732-843b70226dd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc] added
Nov 16 20:15:00 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:00 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce759c04-7a62-4216-a02c-fd086c1ef286]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc69a034-d164-4eaa-86f7-6be7debe8476]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AurcjiyW {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AurcjiyW" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d20f14-84ae-4a74-9a00-5720abf00dae]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AurcjiyW'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3964f7e-c3c6-4503-a39e-cb8de52c71f4]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ffda8-bf56-4f22-8ae7-17a2cc330b53]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:15:01 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:15:01 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:15:01 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:15:01 user nova-compute[86931]: 
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b6eed-f47f-482e-ab3e-0d28f8b65b66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260]
Nov 16 20:15:01 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260] successful.
Nov 16 20:15:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f44028-c7e5-4917-80b3-a2e3598a24cd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f03aa-1756-458a-876a-7b2d3727f19b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)
Nov 16 20:15:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)
Nov 16 20:15:01 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fcb31a-521a-480b-8ac9-d99100fdd07a]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:01 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AurcjiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26264636532353333', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264636532353333', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.objects.instance [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 20:15:02 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:15:02 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:15:02 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:15:02 user nova-compute[86931]:   <serial>fcb36b01-6766-4ff0-8e03-dced148be9cc</serial>
Nov 16 20:15:02 user nova-compute[86931]: </disk>
Nov 16 20:15:02 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No VIF found with MAC fa:16:3e:93:b2:5a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:15:02 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-1346aca9-d149-49dc-8e7c-5b2f02ea2dc8 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.677s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:15:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:15:05 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:15:05 user nova-compute[86931]: INFO nova.compute.manager [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Detaching volume fcb36b01-6766-4ff0-8e03-dced148be9cc
Nov 16 20:15:05 user nova-compute[86931]: INFO nova.virt.block_device [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attempting to driver detach volume fcb36b01-6766-4ff0-8e03-dced148be9cc from mountpoint /dev/vdb
Nov 16 20:15:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Attempting to detach device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 20:15:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:15:05 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:15:05 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:15:05 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:15:05 user nova-compute[86931]:   <serial>fcb36b01-6766-4ff0-8e03-dced148be9cc</serial>
Nov 16 20:15:05 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:15:05 user nova-compute[86931]: </disk>
Nov 16 20:15:05 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:15:05 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config.
Nov 16 20:15:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 20:15:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:15:05 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:15:05 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:15:05 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:15:05 user nova-compute[86931]:   <serial>fcb36b01-6766-4ff0-8e03-dced148be9cc</serial>
Nov 16 20:15:05 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:15:05 user nova-compute[86931]: </disk>
Nov 16 20:15:05 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:15:05 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 20:15:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:25 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 is timed out.
Nov 16 20:15:25 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config.
Nov 16 20:15:25 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AurcjiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:15:25 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2546c9-8796-485e-bf0c-a1e31fc9f325]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:15:25 user nova-compute[86931]: No targets found.
Nov 16 20:15:25 user nova-compute[86931]: iSNS:
Nov 16 20:15:25 user nova-compute[86931]: No targets found.
Nov 16 20:15:25 user nova-compute[86931]: STATIC:
Nov 16 20:15:25 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc
Nov 16 20:15:25 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:15:25 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:15:25 user nova-compute[86931]: FIRMWARE:
Nov 16 20:15:25 user nova-compute[86931]: No targets found.
Nov 16 20:15:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:15:25 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:15:25 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39314ec-df52-48c5-937c-f1ecb80ef802]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd4912-c459-4dd9-9882-fc7c4239f917]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)
Nov 16 20:15:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc (non-flash)
Nov 16 20:15:25 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c642290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f387d-10d7-4189-9460-08d68fe9e8d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c4412f-2cac-4530-8f9b-3af62ddc9f21]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d9bd1-41fb-44eb-9e0d-b4a128bc7545]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:15:25 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e8595-7c43-4e97-8582-9d9b12ffdca7]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b584a5d-6067-4bf2-9cf5-fdeae966a8e2]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[042d9186-7640-4ea2-8aea-62e417503238]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260]
Nov 16 20:15:26 user nova-compute[86931]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc, portal: 172.16.0.220,3260] successful.
Nov 16 20:15:26 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcb36b01-6766-4ff0-8e03-dced148be9cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c73fb-98ea-4f8a-ad65-6e1d400ad97e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== disconnect_volume: return (310ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG nova.objects.instance [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:15:26 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-86b38937-ac57-4912-bc95-2389d761b09e tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:15:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.04632568359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:15:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:15:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:15:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:15:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:15:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:15:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:33 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:33 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:15:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:15:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG nova.objects.instance [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:15:57 user nova-compute[86931]: INFO nova.compute.manager [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attaching volume a6910356-5a96-4f05-a6b6-7b7d179a1fd2 to /dev/vdb
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.utils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3bf597-3764-42e7-91c0-9d762780abee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1061391c3ab6\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7941a42-8fa0-4568-a379-f4037a8855e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd902ab2-79e5-448b-b7b9-8b958232748a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ca6e3-8ee8-44e1-abcf-cd353db5539f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Running cmd (subprocess): nvme version {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] 'nvme version' failed. Not Retrying. {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.nvmeof [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] nvme not present on system {{(pid=86931) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 20:15:57 user nova-compute[86931]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 20:15:57 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742bd09-c852-4bca-9f65-21d90c4f2d58]: (4, '') {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=86931) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.lightos [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] LIGHTOS: no hostnqn found. {{(pid=86931) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG os_brick.utils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1061391c3ab6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG nova.virt.block_device [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating existing volume attachment record: 34195529-2ac6-4f1e-930a-ecd825c10d29 {{(pid=86931) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 20:15:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Calling os-brick to attach iSCSI Volume {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuOVCItk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:16:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:16:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:16:02 user nova-compute[86931]: INFO os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e144b-0a4e-493f-80a7-a0a55148b80b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 20:16:02 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8bedb8-9575-431b-a1be-133ebc3877d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2] added\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2] added
Nov 16 20:16:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f04031-4705-4baa-9a09-cd25dbb66d03]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[893fbb28-c3b2-462d-9929-ab5cafd7aa85]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuOVCItk {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuOVCItk" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea857ded-db9d-419e-95a0-3ed75e7bd33d]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MuOVCItk'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aeb9aa-280d-486a-8a66-95c676a038d6]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e124e2a-6ba4-4648-9408-294e3f9eaf49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:16:02 user nova-compute[86931]:  {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 20:16:02 user nova-compute[86931]:  {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:16:02 user nova-compute[86931]: WARNING os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 20:16:02 user nova-compute[86931]: 
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --login {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac7ac9-25bd-4e0d-bf0b-dd83415f814d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260]
Nov 16 20:16:02 user nova-compute[86931]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260] successful.
Nov 16 20:16:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ef6e3-978c-4b80-9866-f2e436e3fd3e]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca1a98-84a8-41f4-8fb9-fe55ce25700e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)
Nov 16 20:16:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)
Nov 16 20:16:02 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to 172.16.0.220:3260 {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=86931) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=86931) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead64f9b-2975-465a-8b6a-51076e66e26c]: (4, ('- - 0', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:02 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=86931) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuOVCItk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=86931) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26532383261343535', 'path': '/dev/sdb'} {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532383261343535', 'path': '/dev/sdb'} {{(pid=86931) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG nova.objects.instance [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:16:03 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 20:16:03 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:16:03 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:16:03 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:16:03 user nova-compute[86931]:   <serial>a6910356-5a96-4f05-a6b6-7b7d179a1fd2</serial>
Nov 16 20:16:03 user nova-compute[86931]: </disk>
Nov 16 20:16:03 user nova-compute[86931]:  {{(pid=86931) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 20:16:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vda, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:16:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No BDM found with device name vdb, not building metadata. {{(pid=86931) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 20:16:04 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] No VIF found with MAC fa:16:3e:93:b2:5a, not building metadata {{(pid=86931) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 20:16:04 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-075bf940-6e25-4119-953e-31268dc222c7 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.731s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:16:07 user nova-compute[86931]: INFO nova.compute.manager [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Detaching volume a6910356-5a96-4f05-a6b6-7b7d179a1fd2
Nov 16 20:16:07 user nova-compute[86931]: INFO nova.virt.block_device [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Attempting to driver detach volume a6910356-5a96-4f05-a6b6-7b7d179a1fd2 from mountpoint /dev/vdb
Nov 16 20:16:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Attempting to detach device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config. {{(pid=86931) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:16:07 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:16:07 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:16:07 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:16:07 user nova-compute[86931]:   <serial>a6910356-5a96-4f05-a6b6-7b7d179a1fd2</serial>
Nov 16 20:16:07 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:16:07 user nova-compute[86931]: </disk>
Nov 16 20:16:07 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:16:07 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the persistent domain config.
Nov 16 20:16:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config. {{(pid=86931) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.guest [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 20:16:07 user nova-compute[86931]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 20:16:07 user nova-compute[86931]:   <source dev="/dev/sdb"/>
Nov 16 20:16:07 user nova-compute[86931]:   <target dev="vdb" bus="virtio"/>
Nov 16 20:16:07 user nova-compute[86931]:   <serial>a6910356-5a96-4f05-a6b6-7b7d179a1fd2</serial>
Nov 16 20:16:07 user nova-compute[86931]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 20:16:07 user nova-compute[86931]: </disk>
Nov 16 20:16:07 user nova-compute[86931]:  {{(pid=86931) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 20:16:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:17 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:22 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:23 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:27 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 is timed out.
Nov 16 20:16:27 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:27 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully detached device vdb from instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 from the live domain config.
Nov 16 20:16:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] calling os-brick to detach iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa4c6f3820>, {'target_iqn': 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuOVCItk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 20:16:27 user nova-compute[86931]: WARNING os_brick.initiator.connectors.base [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e40f3b3-a68c-4a12-a193-76c1100fec8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 20:16:27 user nova-compute[86931]: No targets found.
Nov 16 20:16:27 user nova-compute[86931]: iSNS:
Nov 16 20:16:27 user nova-compute[86931]: No targets found.
Nov 16 20:16:27 user nova-compute[86931]: STATIC:
Nov 16 20:16:27 user nova-compute[86931]: Target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2
Nov 16 20:16:27 user nova-compute[86931]:         Portal: 172.16.0.220:3260,-1
Nov 16 20:16:27 user nova-compute[86931]:                 Iface Name: default
Nov 16 20:16:27 user nova-compute[86931]: FIRMWARE:
Nov 16 20:16:27 user nova-compute[86931]: No targets found.
Nov 16 20:16:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 20:16:27 user nova-compute[86931]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 20:16:27 user nova-compute[86931]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=86931) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2', 0)] {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ea27b-7825-4415-88c7-5156dfd387e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ea770b-b6a1-466a-acf5-3e055a86e38a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)
Nov 16 20:16:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 (non-flash)
Nov 16 20:16:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2c5593f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2'): ({'sdb'}, set())}) {{(pid=86931) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Removing single pathed devices sdb {{(pid=86931) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cfffb7-6f12-4262-861e-a1720f611469]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9963f3b-6be5-49be-a204-53364797a0ca]: (4, ('ok\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Flushing IO for device /dev/sdb {{(pid=86931) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae688d-9693-4893-adea-e2e8f57a3184]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=86931) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d270b-8f84-40d3-a783-1ba169a1a9f8]: (4, ('1', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.linuxscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] SCSI volumes sdb have been removed. {{(pid=86931) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2')] {{(pid=86931) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd6edab-b28b-4243-9460-d5b557d1b9cd]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --logout {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9422f55-a9a9-41ba-81d1-79e6226ccbdd]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260]
Nov 16 20:16:27 user nova-compute[86931]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2, portal: 172.16.0.220,3260] successful.
Nov 16 20:16:27 user nova-compute[86931]:  stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op delete {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6910356-5a96-4f05-a6b6-7b7d179a1fd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=97490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7602d92-251a-456f-8565-a16d57d04a59]: (4, ('', '')) {{(pid=97490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=86931) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.base [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] <== disconnect_volume: return (291ms) None {{(pid=86931) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 20:16:27 user nova-compute[86931]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Disconnected iSCSI Volume {{(pid=86931) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG nova.objects.instance [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'flavor' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-44a36f54-7b04-4254-963c-bb0a63f7d801 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:28 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG oslo_concurrency.processutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=86931) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 20:16:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:16:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.04535675048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=86931) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:16:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquired lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Forcefully refreshing network info cache for instance {{(pid=86931) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 20:16:30 user nova-compute[86931]: DEBUG nova.objects.instance [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lazy-loading 'info_cache' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:16:31 user nova-compute[86931]: DEBUG nova.network.neutron [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [{"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:16:31 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Releasing lock "refresh_cache-cde7ab0e-ce1d-4b18-81e0-eef883b9b054" {{(pid=86931) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 20:16:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updated the network info_cache for instance {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 20:16:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=86931) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:16:32 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=86931) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 20:16:35 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:35 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:16:37 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:38 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:40 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:16:42 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:16:47 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:52 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:16:57 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:02 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:12 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:13 user nova-compute[86931]: INFO nova.compute.manager [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Terminating instance
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.compute.manager [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Start destroying the instance on the hypervisor. {{(pid=86931) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-unplugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] No waiting events found dispatching network-vif-unplugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.compute.manager [req-836185f9-3cd8-4ffb-a8e2-21866850ab14 req-4736ae98-58ae-47b2-bc15-df948d38064e service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-unplugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 for instance with task_state deleting. {{(pid=86931) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Instance destroyed successfully.
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.objects.instance [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lazy-loading 'resources' on Instance uuid cde7ab0e-ce1d-4b18-81e0-eef883b9b054 {{(pid=86931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.virt.libvirt.vif [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T20:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-929124677',display_name='tempest-SnapshotDataIntegrityTests-server-929124677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-929124677',id=53,image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFperLsdirIdjpbuVEFeojNPYJAeCpta3zis+be3MaY8FrvZtRHkmDrglugSPEkmrzhi6j09IMPrHteLz1LhevCwZeywwyRzsk8u3bN+leSNFcup2ZSdrdADHSrL8IFtg==',key_name='tempest-keypair-1734009199',keypairs=<?>,launch_index=0,launched_at=2023-11-16T20:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68c67df0d4d24e9b90ad811fca07b265',ramdisk_id='',reservation_id='r-0m5op5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='04ef6bdb-1977-4f57-a0fb-6742ffba000b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1284849085',owner_user_name='tempest-SnapshotDataIntegrityTests-1284849085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T20:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa9c7ecf8eb84d808d4106c38e4dae49',uuid=cde7ab0e-ce1d-4b18-81e0-eef883b9b054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converting VIF {"id": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "address": "fa:16:3e:93:b2:5a", "network": {"id": "778d719a-ab0f-4720-90a2-7baa666dd6fa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1472033006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68c67df0d4d24e9b90ad811fca07b265", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa13ee2cf-e5", "ovs_interfaceid": "a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG nova.network.os_vif_util [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5') {{(pid=86931) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG os_vif [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5') {{(pid=86931) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa13ee2cf-e5, bridge=br-int, if_exists=True) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c164555-1788-4192-896c-c0febc688936) {{(pid=86931) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:13 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:13 user nova-compute[86931]: INFO os_vif [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:b2:5a,bridge_name='br-int',has_traffic_filtering=True,id=a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0,network=Network(778d719a-ab0f-4720-90a2-7baa666dd6fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa13ee2cf-e5')
Nov 16 20:17:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Deleting instance files /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054_del
Nov 16 20:17:13 user nova-compute[86931]: INFO nova.virt.libvirt.driver [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Deletion of /opt/stack/data/nova/instances/cde7ab0e-ce1d-4b18-81e0-eef883b9b054_del complete
Nov 16 20:17:14 user nova-compute[86931]: INFO nova.compute.manager [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 20:17:14 user nova-compute[86931]: DEBUG oslo.service.loopingcall [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=86931) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.compute.manager [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Deallocating network for instance {{(pid=86931) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] deallocate_for_instance() {{(pid=86931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.network.neutron [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Updating instance_info_cache with network_info: [] {{(pid=86931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 20:17:14 user nova-compute[86931]: INFO nova.compute.manager [-] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Took 0.78 seconds to deallocate network for instance.
Nov 16 20:17:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.compute.manager [req-dc95a3af-f5c9-46bd-98c1-50816ca3ec5d req-6d0cdcf2-ae79-4fbe-8aa7-bea7a84d098c service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-deleted-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:17:14 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:15 user nova-compute[86931]: INFO nova.scheduler.client.report [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Deleted allocations for instance cde7ab0e-ce1d-4b18-81e0-eef883b9b054
Nov 16 20:17:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-e27ced72-e61b-4184-8b05-ad3f4db8ae59 tempest-SnapshotDataIntegrityTests-1284849085 tempest-SnapshotDataIntegrityTests-1284849085-project-member] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 20:17:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] Acquiring lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:15 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] Lock "cde7ab0e-ce1d-4b18-81e0-eef883b9b054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:15 user nova-compute[86931]: DEBUG nova.compute.manager [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] No waiting events found dispatching network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 {{(pid=86931) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 20:17:15 user nova-compute[86931]: WARNING nova.compute.manager [req-e9d6ecb8-bae4-47ad-b41f-5573bf6e2294 req-e05d3549-5e0f-4abc-8f54-c4e20771d86f service nova] [instance: cde7ab0e-ce1d-4b18-81e0-eef883b9b054] Received unexpected event network-vif-plugged-a13ee2cf-e52f-4e02-a4b1-f42a2a25baf0 for instance with vm_state deleted and task_state None.
Nov 16 20:17:18 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:23 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:17:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.072467803955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:17:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:17:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:17:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:17:31 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:17:31 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:34 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 20:17:36 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:36 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=86931) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 20:17:39 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:39 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:17:44 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:49 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:54 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:17:59 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:04 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:07 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:09 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:10 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:14 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:19 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:24 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:24 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:18:28 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:18:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:18:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:18:28 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:18:28 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=86931) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=86931) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 20:18:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:18:29 user nova-compute[86931]: WARNING nova.virt.libvirt.driver [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Hypervisor/Node resource view: name=user free_ram=9242MB free_disk=25.058677673339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=86931) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=86931) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing inventories for resource provider 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating ProviderTree inventory for provider 3324bc2c-db45-464f-b02b-15105785d59f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Updating inventory in ProviderTree for provider 3324bc2c-db45-464f-b02b-15105785d59f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing aggregate associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, aggregates: None {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Refreshing trait associations for resource provider 3324bc2c-db45-464f-b02b-15105785d59f, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=86931) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.provider_tree [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed in ProviderTree for provider: 3324bc2c-db45-464f-b02b-15105785d59f {{(pid=86931) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.scheduler.client.report [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Inventory has not changed for provider 3324bc2c-db45-464f-b02b-15105785d59f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=86931) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG nova.compute.resource_tracker [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Compute_service record updated for user:user {{(pid=86931) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 20:18:29 user nova-compute[86931]: DEBUG oslo_concurrency.lockutils [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=86931) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 20:18:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:18:30 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:18:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 20:18:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Starting heal instance info cache {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 20:18:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Rebuilding the list of instances to heal {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 20:18:32 user nova-compute[86931]: DEBUG nova.compute.manager [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Didn't find any instances for network info cache update. {{(pid=86931) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 20:18:32 user nova-compute[86931]: DEBUG oslo_service.periodic_task [None req-16640984-fb72-4dce-a0b9-dd3c29e722e3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=86931) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}